-- Logs begin at Mon 2021-04-05 11:21:53 UTC, end at Mon 2021-04-05 12:26:27 UTC. -- Apr 05 11:56:59.115024 dv-cinder-784763-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 11:56:59.123095 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Apr 5 11:56:59 2021] *** Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: nodename: dv-cinder-784763-1-iscsi Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: machine: x86_64 Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: clock source: unix Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: pcre jit disabled Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: detected number of CPU cores: 4 Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: current working directory: / Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: detected binary path: /usr/bin/uwsgi-core Apr 05 11:56:59.125144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: dropping root privileges as early as possible Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: your processes number limit is 47843 Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: your memory page size is 4096 bytes Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: detected max file descriptor number: 2048 Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: lock engine: pthread robust mutexes Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: thunder lock: enabled Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: dropping root privileges after socket binding Apr 05 11:56:59.126047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 05 11:56:59.171050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: Python main interpreter initialized at 0x560a4bfe49c0 Apr 05 11:56:59.171050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: dropping root privileges after plugin initialization Apr 05 11:56:59.171050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: python threads support enabled Apr 05 11:56:59.171050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: your server socket listen backlog is limited to 100 connections Apr 05 11:56:59.171050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: your mercy for graceful operations on workers is 90 seconds Apr 05 11:56:59.171498 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: mapped 402621 bytes (393 KB) for 2 cores Apr 05 11:56:59.171498 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: *** Operational MODE: preforking *** Apr 05 11:56:59.171708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: dropping root privileges after application loading Apr 05 11:56:59.171708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: *** uWSGI is running in multiple interpreter mode *** Apr 05 11:56:59.171708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: spawned uWSGI master process (pid: 83583) Apr 05 11:56:59.171870 dv-cinder-784763-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 11:56:59.172259 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: spawned uWSGI worker 1 (pid: 83584, cores: 1) Apr 05 11:56:59.172590 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: spawned uWSGI worker 2 (pid: 83585, cores: 1) Apr 05 11:56:59.172693 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 11:57:03.897776 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 05 11:57:03.898480 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 05 11:57:03.899706 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 05 11:57:03.900144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 05 11:57:03.900299 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 05 11:57:03.900411 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 05 11:57:03.900514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 05 11:57:03.900862 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.901224 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.901582 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.901941 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.902053 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 05 11:57:03.902341 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.902451 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 05 11:57:03.902653 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 05 11:57:03.902768 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903017 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903122 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903371 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903476 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903739 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.903844 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904032 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904138 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904384 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904492 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904747 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784763-1-iscsi {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.904853 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905100 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905204 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905434 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905542 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905782 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.905882 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906069 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906451 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906551 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906818 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.906919 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784763-1-iscsi {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.907159 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.907300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.907498 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.907773 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.907892 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908120 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908242 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908464 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908588 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908812 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.908929 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.909148 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.909260 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.909514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.909765 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.909885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910112 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910251 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910476 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910593 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910825 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.910929 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911303 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911545 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911654 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784763-1-iscsi {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911888 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.911996 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.912231 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.912328 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.912573 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.912680 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.912939 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.913043 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.913289 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.913402 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.913652 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784763-1-iscsi {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.913759 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.914531 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.914639 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.914884 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.914992 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.915232 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.915337 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.915691 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.915809 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916040 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916144 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916386 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916497 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916739 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.916838 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917081 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917184 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917421 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917544 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.917871 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918116 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918299 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918479 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918584 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918819 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.918923 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919102 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919206 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919444 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919543 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919785 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.919882 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920136 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920239 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920472 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920574 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.920864 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921042 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921147 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921389 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921488 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.921880 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922095 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922226 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922463 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922572 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922746 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.922848 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923031 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923136 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923396 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923510 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923745 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.923853 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924089 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924195 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924424 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924536 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924763 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.924872 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925106 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925212 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925450 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925557 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925793 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.925899 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926146 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926250 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926510 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926622 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926854 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.926959 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927195 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927297 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927554 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927740 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927899 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.927998 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.928235 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.928361 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.928592 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.928698 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.928942 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.929048 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.929274 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.929374 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.930226 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.930564 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.930677 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.930920 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931020 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931265 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931373 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931602 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931702 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.931991 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.932222 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.932333 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.932564 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.932670 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.932921 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933027 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933261 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933366 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933601 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933701 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.933941 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934040 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934253 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934356 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934595 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934695 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.934940 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935040 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935273 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935379 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935613 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935713 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.935951 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936057 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936278 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936384 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936609 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936709 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.936948 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937054 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937284 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937390 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937630 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937750 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.937969 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938078 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938327 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938439 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938662 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938762 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.938992 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.939101 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.939329 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.939435 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.939673 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.939778 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940003 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940342 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940447 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940688 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.940821 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941023 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941134 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941357 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941455 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941702 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.941801 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942036 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942168 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942405 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942505 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942749 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.942853 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943074 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943173 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943411 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943510 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943746 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.943853 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944106 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944205 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944447 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944552 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944784 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.944888 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.945153 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.945268 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.945528 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.945778 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946008 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946105 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946376 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946476 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946716 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.946813 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947053 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947163 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947410 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947513 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947748 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.947858 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948086 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948192 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948424 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948522 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948756 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.948873 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.949088 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.949198 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.949427 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.949526 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.949788 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.949891 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.950160 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.950273 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.950505 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.950618 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.950845 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.950955 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.951187 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.951291 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.951546 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.951644 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 11:57:03.951890 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.951989 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.952239 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.952358 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.952601 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.952705 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.952944 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953046 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953282 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953381 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953628 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953730 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.953988 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.954091 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.954357 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.954458 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.954708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.954811 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955053 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955164 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955404 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955507 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955745 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.955844 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956087 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956192 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956428 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956532 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956781 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.956893 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957127 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957225 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957473 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957576 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957823 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.957958 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.958199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.958321 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.958550 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.958659 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.958907 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959019 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959248 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959349 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959606 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959707 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.959951 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.960058 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.960299 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.960405 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.960644 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.960813 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.961202 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.961313 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.961556 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.961656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.961904 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.962012 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.962308 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.962413 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.962660 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.962760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963010 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963112 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963352 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963457 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963693 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.963800 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964032 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964134 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964376 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964477 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.964816 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965063 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965168 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965412 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965745 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.965853 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966083 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966220 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966452 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966564 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966795 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.966905 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967131 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967230 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967461 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967567 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967805 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.967912 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968153 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968262 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968492 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968592 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968845 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.968937 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969185 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969291 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969523 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969628 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969859 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.969960 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.970230 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.970334 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.970570 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.970670 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.970908 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971002 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971247 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971353 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971591 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971699 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.971926 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972027 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972279 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972366 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972614 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972723 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.972952 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973053 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973298 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973398 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973645 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973752 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.973986 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.974087 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.974353 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.974455 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.974709 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.974823 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975052 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975152 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975381 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975489 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975727 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.975833 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.976065 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.976164 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.976924 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977041 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977272 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977379 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977603 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977714 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.977932 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.978070 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.978438 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.978548 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.978795 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.978895 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979130 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979230 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979467 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979568 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979810 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.979910 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980150 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980249 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980484 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980586 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980815 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.980989 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.981179 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.981343 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.981529 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.981694 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.981871 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982042 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982273 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982440 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982625 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982793 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.982987 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.983140 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.983340 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.983505 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.983689 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.983789 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984031 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984169 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984371 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984484 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984717 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.984868 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985080 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985223 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985420 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985590 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985764 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.985948 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.986103 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.986325 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.986473 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.986674 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.986830 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987020 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987208 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987371 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987551 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987740 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.987897 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988087 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988260 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988437 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988606 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988785 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.988949 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989134 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989295 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989497 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989607 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989876 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.989976 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.990269 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.990372 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.990616 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.990728 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.990963 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.991068 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.991308 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.991417 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.991648 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.991760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.992063 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.992302 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.992408 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.992706 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.992797 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993058 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993140 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993414 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993577 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993765 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.993936 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.994160 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.994472 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.994831 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.995182 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.995430 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.995523 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.995845 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.995946 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.996196 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.996297 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.996562 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.996683 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.996916 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.997016 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.997281 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.997362 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.997645 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.997735 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.998090 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.998358 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.998469 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.998565 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.998801 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.999157 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.999504 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:03.999849 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.000192 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.000584 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.000934 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.001277 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.001637 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.001999 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.002403 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.002594 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.002745 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.003096 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.003207 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.003444 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.003621 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.003809 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004010 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004161 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004387 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004487 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004775 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.004881 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005156 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005257 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005506 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005606 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005855 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.005963 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.006242 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.006347 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.006586 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.006687 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.006936 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.007052 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.007283 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.007390 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.008167 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.008278 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.008530 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.008770 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.008879 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.009248 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.009552 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.009653 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.009929 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.010036 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.010320 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.010423 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.010684 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.010785 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011040 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011142 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011391 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011492 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011739 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.011840 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.012102 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.012203 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.012444 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.012544 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.012789 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013140 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013262 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013481 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013596 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013825 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.013925 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014209 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014324 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014554 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014898 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.014998 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.015240 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.015341 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.015587 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.015687 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.015928 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016028 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016270 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016371 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016610 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016710 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.016953 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017054 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017401 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017644 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017750 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.017987 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.018087 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.018426 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.018555 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.018673 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.018782 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.019277 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.019388 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.019621 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.019721 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.019962 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.020063 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.020298 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.020463 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.020640 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.020741 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021002 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021109 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021351 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021471 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021711 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.021815 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022060 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022215 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022435 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022544 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022779 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.022879 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.023123 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.023856 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024000 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024254 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024414 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024608 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024709 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.024963 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.025071 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.025307 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.025408 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.025656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.025756 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026011 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026145 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026387 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026487 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026728 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.026828 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027076 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027247 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027405 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027556 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027718 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.027867 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028031 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028193 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028343 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028503 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028675 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028824 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.028977 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.029145 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.029296 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.029446 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.029635 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.029792 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030000 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030170 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030396 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030549 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030733 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.030893 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031061 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031211 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031398 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031563 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031720 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.031875 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032045 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032195 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032343 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032493 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032700 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.032865 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033037 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033187 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033337 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033485 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033680 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.033845 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034012 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034192 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034347 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034511 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034660 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034815 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.034979 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035135 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035448 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035605 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035763 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.035911 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036059 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036249 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036401 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036614 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036782 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.036946 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037094 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037252 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037401 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037594 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037761 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.037910 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038072 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038320 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038475 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038633 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038782 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.038991 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.039151 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.039337 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.039627 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.039799 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.039944 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040096 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040244 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040393 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040540 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040696 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.040846 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041007 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041168 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041330 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041479 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041648 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041738 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.041974 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.042156 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.042326 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.042475 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.042676 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.042828 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043027 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043191 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043381 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043557 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043716 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.043866 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044067 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044217 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044416 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044524 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.044851 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045099 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045205 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045450 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045558 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045790 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.045891 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046315 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046496 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046604 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046847 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.046948 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047208 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047308 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047549 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047897 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.047998 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.048248 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.048348 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.048663 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.048771 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.048920 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049021 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049269 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049373 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049611 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049712 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.049960 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.050059 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.050327 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.050430 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.050671 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.050777 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051021 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051122 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051364 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051464 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051712 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.051819 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052174 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052393 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052565 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.052857 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053107 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053213 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053454 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053568 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053826 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.053927 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.054175 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.054281 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055061 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055305 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055415 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055517 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055732 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.055906 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.056096 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.056388 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.056490 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.056745 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.056917 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057098 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057276 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057451 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057633 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057799 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.057984 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.058184 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.058367 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.058516 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.058724 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.058885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059086 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059230 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059447 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059549 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059801 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.059908 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.060225 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.060328 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.060568 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.060669 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.060933 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061032 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061280 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061380 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061630 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.061977 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.062082 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.062359 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.062524 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.062731 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.062877 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063078 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063228 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063426 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063593 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063771 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.063958 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.064143 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.064327 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.064489 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.064671 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.064854 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.065023 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.065335 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.065435 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.065690 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.065796 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066037 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066163 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066406 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066526 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066765 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.066872 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067111 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067211 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067479 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067580 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067847 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.067953 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.068199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.068300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.068548 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.068648 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.068904 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.069005 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.069259 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.069404 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.069638 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.069743 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.070006 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.070760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071001 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071102 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071432 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071532 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071780 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.071886 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072134 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072240 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072483 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072591 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072829 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.072928 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073196 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073295 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073535 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073665 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073888 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.073988 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.074286 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.074399 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.074638 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.074827 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.074978 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.075128 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.075302 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.075435 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.075670 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.075783 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076013 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076370 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076478 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076706 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.076807 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077065 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077163 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077406 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077503 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077749 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.077847 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078096 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078254 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078468 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078578 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078807 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.078908 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079141 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079239 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079485 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079597 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079828 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.079928 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.080195 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.080354 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.080522 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.080685 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.080891 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081043 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081263 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081423 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081585 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081742 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.081956 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.082112 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.082321 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.082471 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.082655 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.082815 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083004 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083155 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083350 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083671 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083836 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.083988 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.084137 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.084320 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.084471 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.084668 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.084780 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085014 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085357 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085458 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085743 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.085913 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.086071 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.086321 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.086449 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.086693 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.086794 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087060 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087169 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087406 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087760 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.087861 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088106 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088213 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088450 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088549 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088792 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.088898 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089135 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089242 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089483 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089631 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089834 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.089936 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.090195 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.090300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.090547 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.090721 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.090884 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091040 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091238 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091404 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091552 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091702 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.091929 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092093 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092255 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092604 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092710 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.092951 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.093063 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.093300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.093400 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.093656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.093756 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094009 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094117 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094406 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094511 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094756 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.094922 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095086 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095249 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095399 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095548 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095757 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.095910 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.096145 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.096358 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.096511 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.096727 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.096878 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097082 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097251 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097402 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097551 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097759 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.097910 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098117 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098302 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098463 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098613 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098813 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.098982 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099151 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099300 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099461 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099624 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099808 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.099962 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.100171 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106380 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106499 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106580 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106666 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106740 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106819 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106892 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.106961 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107037 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107037 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107171 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107242 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107310 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107379 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107447 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107515 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107590 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107662 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107730 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107798 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107866 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.107941 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108018 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108089 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108164 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108234 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108304 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108304 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108512 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108585 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108655 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108729 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108814 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.108959 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109030 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109097 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109166 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109241 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109312 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109386 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109456 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109524 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109599 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.109670 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.110410 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.110585 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.110932 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111083 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111242 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111389 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111535 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111680 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111823 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.111823 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112115 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112115 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112394 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112540 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112691 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112845 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.112992 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113167 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113320 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113466 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113631 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113786 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.113947 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114104 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114285 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114452 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114603 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114757 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.114902 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115047 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115191 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115346 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115346 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115633 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115778 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.115934 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116085 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116231 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116384 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116537 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116683 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.116833 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.117529 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.117735 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.117994 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.118280 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.118280 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.118570 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.118570 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.118858 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.119393 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.119557 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.119705 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.119859 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120006 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120163 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120316 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120468 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120616 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120762 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.120918 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121072 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121219 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121363 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121508 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121655 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121799 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.121952 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122104 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122104 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122407 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122553 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.122875 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123023 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123167 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123167 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123586 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123739 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.123885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124030 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124174 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124392 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124581 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124732 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.124894 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125041 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125193 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125345 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125497 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125644 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125796 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.125944 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126090 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126273 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126430 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126578 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126723 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.126877 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.127022 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128272 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128420 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128565 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128718 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.128871 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129030 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129176 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129321 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129465 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129610 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129770 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.129924 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130077 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130278 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130426 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130572 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130716 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.130872 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131020 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131167 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131311 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131456 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131607 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131770 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.131916 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132062 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132208 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132358 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132504 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132836 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.132996 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133145 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133145 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133503 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133827 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133982 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.133982 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.134301 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.134447 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.134592 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.134748 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.134894 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135039 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135191 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135345 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135491 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135645 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135792 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.135946 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136099 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136245 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136390 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136549 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136700 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136844 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.136995 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137140 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137285 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137439 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137585 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137729 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.137729 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138015 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138202 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138355 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138511 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138656 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138801 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.138951 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139105 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139251 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139396 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139541 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139685 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139839 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.139992 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.140147 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.140440 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.140593 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.140737 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.140882 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.141101 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.141249 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.141399 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.141546 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.141702 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.142377 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.142544 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.142706 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.142859 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143005 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143172 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143323 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143474 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143625 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.143788 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144209 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144370 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144521 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144672 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144835 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.144985 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145142 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145293 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145443 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145593 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145743 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.145904 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146066 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146282 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146470 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146622 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146785 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.146952 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147115 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147278 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147427 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147574 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147725 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.147920 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.148090 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.148817 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149064 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149276 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149441 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149659 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149811 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.149973 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150147 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150301 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150451 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150613 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150763 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150913 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.150913 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151225 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151389 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151539 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151699 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151807 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.151905 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152000 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152102 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152199 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152294 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152394 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152637 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.152744 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153005 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153116 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153356 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153457 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153716 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.153816 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154058 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154245 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154544 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154794 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.154895 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155152 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155254 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155506 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155608 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155862 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.155979 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.156216 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.156318 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.156560 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.156662 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.156907 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157015 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157255 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157356 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157613 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157725 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.157972 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.158084 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.158354 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.158458 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.158707 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.158823 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159054 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159169 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159412 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159517 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.159852 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160097 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160205 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160543 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160784 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.160885 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161136 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161239 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161492 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161593 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161860 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.161965 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.162227 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.162333 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.162594 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.162695 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.162942 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.163053 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.163294 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.163405 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.163649 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.163750 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164046 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164200 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164404 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164581 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164787 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.164937 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165143 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165292 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165498 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165644 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165852 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.165996 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.166231 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.166398 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.166589 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.166754 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.166945 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.167123 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.167319 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.167489 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.167693 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.167855 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168039 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168225 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168412 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168619 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168773 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.168971 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.169134 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.169362 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.169472 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.169734 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.169835 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.170015 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83585) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:57:04.170198 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.170553 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.170912 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.171265 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.171618 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.171977 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.172337 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.172708 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.173078 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.173450 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.173822 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.174245 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.174602 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.174995 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.175372 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 11:57:04.175655 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83584) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 05 11:57:04.206193 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83585) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.211073 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83584) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.469050 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.context [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1366092d-f79f-474c-849a-63f2d02cf0e6(cell1) {{(pid=83585) load_cells /opt/stack/nova/nova/context.py:466}} Apr 05 11:57:04.474464 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83585) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 11:57:04.475234 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.context [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1366092d-f79f-474c-849a-63f2d02cf0e6(cell1) {{(pid=83584) load_cells /opt/stack/nova/nova/context.py:466}} Apr 05 11:57:04.476298 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83585) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 11:57:04.477884 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83585) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 11:57:04.480071 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83585) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 11:57:04.481186 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 11:57:04.483078 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 11:57:04.483954 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 11:57:04.486077 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 11:57:04.502919 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83585) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.513457 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83584) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.514458 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83584) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.516169 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83585) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.541164 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83585) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.546311 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_db.sqlalchemy.engines [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83584) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 11:57:04.640427 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:57:04.640427 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: from cryptography.utils import int_from_bytes Apr 05 11:57:04.640780 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:57:04.640780 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: from cryptography.utils import int_from_bytes Apr 05 11:57:04.644330 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:57:04.644330 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: from cryptography.utils import int_from_bytes Apr 05 11:57:04.644714 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 11:57:04.644714 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: from cryptography.utils import int_from_bytes Apr 05 11:57:04.718633 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading Gnome Apr 05 11:57:04.726180 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading Gnome Apr 05 11:57:04.739652 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading Google Apr 05 11:57:04.743378 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading Windows (alt) Apr 05 11:57:04.747937 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading Google Apr 05 11:57:04.748059 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading file Apr 05 11:57:04.749059 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading keyczar Apr 05 11:57:04.749514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading multi Apr 05 11:57:04.750417 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Loading pyfs Apr 05 11:57:04.751367 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading Windows (alt) Apr 05 11:57:04.755961 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading file Apr 05 11:57:04.757055 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading keyczar Apr 05 11:57:04.757507 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading multi Apr 05 11:57:04.759397 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO keyring.backend [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Loading pyfs Apr 05 11:57:05.040056 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:57:05.047363 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:57:05.049604 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:57:05.057852 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:57:05.385350 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:57:05.391028 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:57:05.394954 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 11:57:05.396923 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a4bfe49c0 pid: 83585 (default app) Apr 05 11:57:05.399240 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:57:05.400422 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001869 Apr 05 11:57:05.400829 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WARNING keystonemiddleware.auth_token [None req-ea85c514-a52a-4f8a-b33e-464160cba601 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 11:57:05.400949 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 779 bytes} [Mon Apr 5 11:57:05 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:57:05.406403 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560a4bfe49c0 pid: 83584 (default app) Apr 05 11:58:31.341016 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:31.342181 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Apr 05 11:58:31.342607 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:31.823636 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-62f3e4cb-2182-4a96-9e2c-d523002ab18e admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:31.851334 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-62f3e4cb-2182-4a96-9e2c-d523002ab18e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.500759 Apr 05 11:58:31.851908 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1281 bytes} [Mon Apr 5 11:58:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:34.326573 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:34.327633 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-9aa0cd2a-77fa-441e-b3e0-4c3e88a31398 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Apr 05 11:58:34.328101 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:34.388084 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-21368c5c-c651-46d5-95ba-0ec790156005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:34.411591 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:58:34.411591 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 11:58:34.438639 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-21368c5c-c651-46d5-95ba-0ec790156005 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103987 Apr 05 11:58:34.439232 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:34 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:34.680665 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-4f810e51-1b9a-47a5-93ae-70179ae392bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:34.684026 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:58:34.684026 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 11:58:34.726406 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-4f810e51-1b9a-47a5-93ae-70179ae392bb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278060 Apr 05 11:58:34.727032 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1325 bytes} [Mon Apr 5 11:58:34 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:37.184044 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-21368c5c-c651-46d5-95ba-0ec790156005 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:37.185127 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-21368c5c-c651-46d5-95ba-0ec790156005 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 05 11:58:37.185561 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:37.300854 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-3c5bccde-0099-45f5-a4c1-099859b5b4b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:37.324028 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:58:37.324028 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 11:58:37.347631 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-3c5bccde-0099-45f5-a4c1-099859b5b4b0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155705 Apr 05 11:58:37.348218 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:37.361545 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-6fe84ace-32ba-43ed-863a-712da9402a9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:37.363114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 11:58:37.363114 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 11:58:37.399625 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-6fe84ace-32ba-43ed-863a-712da9402a9c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042035 Apr 05 11:58:37.400238 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1325 bytes} [Mon Apr 5 11:58:37 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:39.890371 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-3c5bccde-0099-45f5-a4c1-099859b5b4b0 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:39.891445 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-3c5bccde-0099-45f5-a4c1-099859b5b4b0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Apr 05 11:58:39.891878 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:39.952651 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-95c1f62c-0e06-4873-928f-31264a073ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "swap": 0}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:39.976290 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-95c1f62c-0e06-4873-928f-31264a073ea2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077748 Apr 05 11:58:39.976883 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:39.989418 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-40b2a92b-80e9-4294-81df-a037d9541e82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:40.026397 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-40b2a92b-80e9-4294-81df-a037d9541e82 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040918 Apr 05 11:58:40.026997 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1325 bytes} [Mon Apr 5 11:58:39 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:42.495351 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-95c1f62c-0e06-4873-928f-31264a073ea2 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:42.496449 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-95c1f62c-0e06-4873-928f-31264a073ea2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Apr 05 11:58:42.496878 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:42.556873 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e660eb5d-b772-4b7d-9dc3-8da012fe137e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:42.586512 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e660eb5d-b772-4b7d-9dc3-8da012fe137e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083162 Apr 05 11:58:42.587107 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:42.600012 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-4afc020d-f6df-4ceb-87e2-c8223e4b4232 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:42.635828 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-4afc020d-f6df-4ceb-87e2-c8223e4b4232 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039952 Apr 05 11:58:42.636419 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1325 bytes} [Mon Apr 5 11:58:42 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:45.113104 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e660eb5d-b772-4b7d-9dc3-8da012fe137e admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:45.114231 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e660eb5d-b772-4b7d-9dc3-8da012fe137e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Apr 05 11:58:45.115225 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:45.175065 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:45.199724 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077998 Apr 05 11:58:45.200301 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:45.213013 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-6c34128a-c496-40a4-ac78-ed20faa5f83a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:45.248817 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-6c34128a-c496-40a4-ac78-ed20faa5f83a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039830 Apr 05 11:58:45.249416 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1325 bytes} [Mon Apr 5 11:58:45 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:47.714154 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:47.715342 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Apr 05 11:58:47.715781 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:47.775804 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-54653533-bc0e-4d53-bdb4-8fb5ee94ca23 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:47.800501 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-54653533-bc0e-4d53-bdb4-8fb5ee94ca23 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078258 Apr 05 11:58:47.801071 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1281 bytes} [Mon Apr 5 11:58:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 11:58:50.301918 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:50.303573 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-ee7e9759-9163-44ae-b185-078d947ff5e0 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Apr 05 11:58:50.304007 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:50.363482 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-1facb688-dcfe-4a32-9045-e0320ca95208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "vcpus": 1}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:50.387384 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-1facb688-dcfe-4a32-9045-e0320ca95208 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076985 Apr 05 11:58:50.387967 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:50 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:50.400971 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-b31c86af-eaa7-4cf5-b587-325a756274cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:50.436497 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-b31c86af-eaa7-4cf5-b587-325a756274cf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039619 Apr 05 11:58:50.437081 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1322 bytes} [Mon Apr 5 11:58:50 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:52.918773 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-1facb688-dcfe-4a32-9045-e0320ca95208 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:52.919842 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-1facb688-dcfe-4a32-9045-e0320ca95208 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Apr 05 11:58:52.920275 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:52.980619 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bce6a19c-cc74-47b6-8ba3-97ab95326de4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:53.006347 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bce6a19c-cc74-47b6-8ba3-97ab95326de4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079537 Apr 05 11:58:53.006925 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:53.019827 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-0460730f-bc85-4db5-a0fb-fafaf6ff84b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:53.056060 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-0460730f-bc85-4db5-a0fb-fafaf6ff84b2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040391 Apr 05 11:58:53.056663 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1322 bytes} [Mon Apr 5 11:58:53 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:55.533504 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bce6a19c-cc74-47b6-8ba3-97ab95326de4 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:55.534605 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bce6a19c-cc74-47b6-8ba3-97ab95326de4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Apr 05 11:58:55.535039 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:55.601563 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-63f51a9d-2da0-4e30-9d31-721675094c4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "swap": 0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:55.626262 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-63f51a9d-2da0-4e30-9d31-721675094c4a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084118 Apr 05 11:58:55.626846 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:55.639630 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-9516ce5d-d663-4488-83e2-4f6b3cab5dbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:55.674790 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-9516ce5d-d663-4488-83e2-4f6b3cab5dbd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039088 Apr 05 11:58:55.675376 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1322 bytes} [Mon Apr 5 11:58:55 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:58:58.164520 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-63f51a9d-2da0-4e30-9d31-721675094c4a admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:58:58.165614 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-63f51a9d-2da0-4e30-9d31-721675094c4a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Apr 05 11:58:58.166049 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:58:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:58:58.225970 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-312eb433-4a59-4b8f-9062-a7190b412a03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:58.249715 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-312eb433-4a59-4b8f-9062-a7190b412a03 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077395 Apr 05 11:58:58.250325 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:58:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:58:58.263700 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-6c71dfdc-681a-4d69-8e46-c833fc49bc85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:58:58.299611 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-6c71dfdc-681a-4d69-8e46-c833fc49bc85 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039886 Apr 05 11:58:58.300212 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1322 bytes} [Mon Apr 5 11:58:58 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 11:59:00.780282 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-312eb433-4a59-4b8f-9062-a7190b412a03 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 11:59:00.781349 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-312eb433-4a59-4b8f-9062-a7190b412a03 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Apr 05 11:59:00.781778 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 11:59:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 11:59:00.842601 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:59:00.867119 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078061 Apr 05 11:59:00.867700 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1272 bytes} [Mon Apr 5 11:59:00 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 11:59:00.880346 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e9df7e96-f720-4220-aac9-6bd9bce25c8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 11:59:00.915923 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e9df7e96-f720-4220-aac9-6bd9bce25c8b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039574 Apr 05 11:59:00.916514 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1322 bytes} [Mon Apr 5 11:59:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:00:13.174219 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:13.175292 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Apr 05 12:00:13.175737 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 920 bytes} [Mon Apr 5 12:00:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:13.236001 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-47542166-a343-439f-984e-62d3baeb35a5 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:13.262281 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-47542166-a343-439f-984e-62d3baeb35a5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079416 Apr 05 12:00:13.262847 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1281 bytes} [Mon Apr 5 12:00:13 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:14.925751 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:14.926883 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-e1d8e5be-fa96-41fd-b180-bd04e9666153 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Apr 05 12:00:14.927311 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:15.113349 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-552e736e-0ec4-4086-ad2a-f44995622f52 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:15.129920 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-552e736e-0ec4-4086-ad2a-f44995622f52 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 12:00:15.130616 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-552e736e-0ec4-4086-ad2a-f44995622f52 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:15.131502 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-552e736e-0ec4-4086-ad2a-f44995622f52 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.072764 Apr 05 12:00:15.132068 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1181 bytes} [Mon Apr 5 12:00:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:15.142723 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-096955f2-6431-45e3-96cd-70e4dc58c9d4 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:15.164991 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-096955f2-6431-45e3-96cd-70e4dc58c9d4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026235 Apr 05 12:00:15.165630 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:15.176075 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-2b68d5a7-5010-4f3f-a9e8-f1c97df81557 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:15.198687 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-2b68d5a7-5010-4f3f-a9e8-f1c97df81557 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026390 Apr 05 12:00:15.199250 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:15.209093 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-0e66a4c5-7e4f-45ed-bbc4-ab3238f15466 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:15.223064 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-0e66a4c5-7e4f-45ed-bbc4-ab3238f15466 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 05 12:00:15.223690 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-0e66a4c5-7e4f-45ed-bbc4-ab3238f15466 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:15.224533 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-0e66a4c5-7e4f-45ed-bbc4-ab3238f15466 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.019217 Apr 05 12:00:15.225064 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1181 bytes} [Mon Apr 5 12:00:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:16.790060 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-2b68d5a7-5010-4f3f-a9e8-f1c97df81557 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:16.791818 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-2b68d5a7-5010-4f3f-a9e8-f1c97df81557 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Apr 05 12:00:16.792244 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:00:16.972404 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-c48bde5d-736b-42fb-9b43-3608ada55bba admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:16.987577 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-c48bde5d-736b-42fb-9b43-3608ada55bba admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 12:00:16.988191 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-c48bde5d-736b-42fb-9b43-3608ada55bba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:16.989039 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-c48bde5d-736b-42fb-9b43-3608ada55bba admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.070321 Apr 05 12:00:16.989616 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1181 bytes} [Mon Apr 5 12:00:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:17.000442 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-ba464cb9-ffc9-4339-9627-41b9ed2b3e0f admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:17.022474 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-ba464cb9-ffc9-4339-9627-41b9ed2b3e0f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025949 Apr 05 12:00:17.023033 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:17.034621 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-a1d68f06-2f1c-4478-b0f4-7552f6c909a2 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:17.057485 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-a1d68f06-2f1c-4478-b0f4-7552f6c909a2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026634 Apr 05 12:00:17.058056 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:17.068136 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-77225051-b37c-40f8-a202-3ae25b5e7eef admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:17.081250 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-77225051-b37c-40f8-a202-3ae25b5e7eef admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 05 12:00:17.081869 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-77225051-b37c-40f8-a202-3ae25b5e7eef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:17.082726 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-77225051-b37c-40f8-a202-3ae25b5e7eef admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018419 Apr 05 12:00:17.083258 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1181 bytes} [Mon Apr 5 12:00:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:18.646568 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-a1d68f06-2f1c-4478-b0f4-7552f6c909a2 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:18.647682 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-a1d68f06-2f1c-4478-b0f4-7552f6c909a2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Apr 05 12:00:18.648112 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:18.829317 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-71c5dda5-e412-4338-8063-26a5e6f83578 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:18.842109 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-71c5dda5-e412-4338-8063-26a5e6f83578 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 12:00:18.842780 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-71c5dda5-e412-4338-8063-26a5e6f83578 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:18.843623 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-71c5dda5-e412-4338-8063-26a5e6f83578 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.068645 Apr 05 12:00:18.844162 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1184 bytes} [Mon Apr 5 12:00:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:18.855055 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bc8dc717-f042-4cba-a7a3-c0f45ce0819e admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:18.877523 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bc8dc717-f042-4cba-a7a3-c0f45ce0819e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027162 Apr 05 12:00:18.878087 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:18.888250 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:18.910078 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025786 Apr 05 12:00:18.910663 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1201 bytes} [Mon Apr 5 12:00:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:00:18.921051 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-165c8c70-6ca4-4db6-b2e0-eba0fa515255 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:18.933882 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.wsgi [None req-165c8c70-6ca4-4db6-b2e0-eba0fa515255 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 05 12:00:18.934527 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-165c8c70-6ca4-4db6-b2e0-eba0fa515255 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:00:18.935373 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-165c8c70-6ca4-4db6-b2e0-eba0fa515255 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018164 Apr 05 12:00:18.935906 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1184 bytes} [Mon Apr 5 12:00:18 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 05 12:00:20.499215 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:20.500289 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Apr 05 12:00:20.500713 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:20.681586 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-f4550443-6a46-43f8-9358-bcc4dcfbddfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:00:20.705276 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-f4550443-6a46-43f8-9358-bcc4dcfbddfd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.077541 Apr 05 12:00:20.705798 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1226 bytes} [Mon Apr 5 12:00:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:22.272383 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:22.273450 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Apr 05 12:00:22.273878 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:00:22.456325 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-63fddfdd-efaf-4876-bd8d-50092ffa4888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:00:22.480236 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-63fddfdd-efaf-4876-bd8d-50092ffa4888 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.078111 Apr 05 12:00:22.480815 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1226 bytes} [Mon Apr 5 12:00:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:24.043435 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:24.044579 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Apr 05 12:00:24.045004 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:24.228709 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-babe03c9-d64e-4be4-bca5-4fc5c438b4b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:00:24.252716 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-babe03c9-d64e-4be4-bca5-4fc5c438b4b5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077625 Apr 05 12:00:24.253249 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1226 bytes} [Mon Apr 5 12:00:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:25.907452 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:25.908573 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Apr 05 12:00:25.909008 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:26.095542 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-0a9e46e6-2a9a-4eb6-b2d7-658393214c37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:00:26.121188 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-0a9e46e6-2a9a-4eb6-b2d7-658393214c37 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.080405 Apr 05 12:00:26.121706 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1226 bytes} [Mon Apr 5 12:00:26 2021] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:00:27.694789 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:27.695855 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Apr 05 12:00:27.696281 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:00:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:00:27.878555 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-f9766e2e-d1a2-47f3-a43e-4cbbcbbbab1c admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:00:27.907433 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-f9766e2e-d1a2-47f3-a43e-4cbbcbbbab1c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082336 Apr 05 12:00:27.907948 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Apr 5 12:00:27 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:01:18.756598 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:01:18.757670 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-bdc489c5-71df-41d9-8f65-984c7f26e188 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 05 12:01:18.758099 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 31/63] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:01:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:01:18.942546 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:01:18.970477 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082282 Apr 05 12:01:18.970994 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1193 bytes} [Mon Apr 5 12:01:18 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:02:51.462813 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-2ed022fd-477c-4c6e-99bf-b15a04e47335 tempest-verify_tempest_config-1371791522 tempest-verify_tempest_config-1371791522-project] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:02:51.464979 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-2ed022fd-477c-4c6e-99bf-b15a04e47335 tempest-verify_tempest_config-1371791522 tempest-verify_tempest_config-1371791522-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120836 Apr 05 12:02:51.465554 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1124 bytes} [Mon Apr 5 12:02:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:04:25.371801 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:04:25.372883 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Apr 05 12:04:25.373323 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 34/66] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:04:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:25.629493 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:04:25.630898 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:04:25.630898 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 12:04:25.632519 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:04:25.633043 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:04:25.633876 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:04:25.634373 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:04:25.672565 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-1d0a9b65-8d84-4037-b02e-fbb548ebbac3 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.168849 Apr 05 12:04:25.673156 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1184 bytes} [Mon Apr 5 12:04:25 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:04:27.260568 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] Calling method '>' {{(pid=83585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:04:27.261628 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-f8e6efc9-b25a-4233-8ae7-af0c2697dce3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Apr 05 12:04:27.262079 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83585|app: 0|req: 35/68] 10.222.0.36 () {56 vars in 1065 bytes} [Mon Apr 5 12:04:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:04:27.451578 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG nova.api.openstack.wsgi [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] Calling method '>' {{(pid=83584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:04:27.452874 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:04:27.452874 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: warnings.warn(msg) Apr 05 12:04:27.454528 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:04:27.455024 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:04:27.455887 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:04:27.456375 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: DEBUG oslo_concurrency.lockutils [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83584) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:04:27.483976 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: INFO nova.api.openstack.requestlog [None req-9f073afe-0434-457d-83ec-193825a647b2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.092861 Apr 05 12:04:27.484575 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: [pid: 83584|app: 0|req: 34/69] 10.222.0.36 () {60 vars in 1184 bytes} [Mon Apr 5 12:04:27 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:05:24.208409 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: Mon Apr 5 12:05:24 2021 - graceful shutdown triggered... Apr 05 12:05:24.208900 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: Gracefully killing worker 1 (pid: 83584)... Apr 05 12:05:24.208476 dv-cinder-784763-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 05 12:05:24.210468 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: Gracefully killing worker 2 (pid: 83585)... Apr 05 12:05:25.209783 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: worker 1 buried after 1 seconds Apr 05 12:05:25.209783 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: worker 2 buried after 1 seconds Apr 05 12:05:25.209783 dv-cinder-784763-1-iscsi devstack@n-api.service[83583]: goodbye to uWSGI. Apr 05 12:05:25.211675 dv-cinder-784763-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 05 12:05:25.213409 dv-cinder-784763-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 05 12:05:25.221526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: *** Starting uWSGI 2.0.15-debian (64bit) on [Mon Apr 5 12:05:25 2021] *** Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: nodename: dv-cinder-784763-1-iscsi Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: machine: x86_64 Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: clock source: unix Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: pcre jit disabled Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: detected number of CPU cores: 4 Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: current working directory: / Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: detected binary path: /usr/bin/uwsgi-core Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: dropping root privileges as early as possible Apr 05 12:05:25.223611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: your processes number limit is 47843 Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: your memory page size is 4096 bytes Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: detected max file descriptor number: 2048 Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: lock engine: pthread robust mutexes Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: thunder lock: enabled Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: dropping root privileges after socket binding Apr 05 12:05:25.224677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 05 12:05:25.270222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Python main interpreter initialized at 0x55d0e67fc9c0 Apr 05 12:05:25.270222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: dropping root privileges after plugin initialization Apr 05 12:05:25.270222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: python threads support enabled Apr 05 12:05:25.270222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: your server socket listen backlog is limited to 100 connections Apr 05 12:05:25.270222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: your mercy for graceful operations on workers is 90 seconds Apr 05 12:05:25.270723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: mapped 402621 bytes (393 KB) for 2 cores Apr 05 12:05:25.270723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: *** Operational MODE: preforking *** Apr 05 12:05:25.270907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: dropping root privileges after application loading Apr 05 12:05:25.270907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: *** uWSGI is running in multiple interpreter mode *** Apr 05 12:05:25.270907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: spawned uWSGI master process (pid: 98310) Apr 05 12:05:25.271056 dv-cinder-784763-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 05 12:05:25.271324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: spawned uWSGI worker 1 (pid: 98311, cores: 1) Apr 05 12:05:25.272142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: spawned uWSGI worker 2 (pid: 98312, cores: 1) Apr 05 12:05:25.272294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 05 12:05:30.382809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 05 12:05:30.383359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 05 12:05:30.384693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 05 12:05:30.385132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 05 12:05:30.385431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 05 12:05:30.385898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.386295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.386668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.387035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.387399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.387754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.388122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.388488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.388868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.389169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.389539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.389915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784763-1-iscsi {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.390323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.390675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.391032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.391401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.391752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.392124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.392475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.393378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.393762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.394140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.394504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.394897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.395304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.395617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.395991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.396347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.397647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.398095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.399202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784763-1-iscsi {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.399202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.399202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.399579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.400022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.400380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.400735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.401107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.401275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 05 12:05:30.401482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.401588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 05 12:05:30.407657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.407657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.407657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.407657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 05 12:05:30.408098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 05 12:05:30.408247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 05 12:05:30.408403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.408969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.409968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784763-1-iscsi {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.410931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.411978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.412122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.412291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.412916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.413931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.414014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.414095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.414675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.414861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784763-1-iscsi {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.415913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.416979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.417895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.418864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.419016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.419973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.420904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.421988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.422939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.423987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.424902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.425948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.426955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.427995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.428897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.429042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.429191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.429340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.430277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.430448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.430594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.430739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.430896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.431936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.432993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.433900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.434973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.435131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.435281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.435432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.435582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.435732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.435882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.436033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.436185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.436343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.436494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.436646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.436797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.436940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.437100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.437250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.437394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.437550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.437700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.437843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.437843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.438203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.438374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.438526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.438732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.438887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.439036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.439190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.439342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.439494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.440084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.440574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.440729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.440880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.441037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.441190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.441340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.441484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.441628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.441785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.441941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.442091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.442276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.442523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.442687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.442850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.443002 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.443154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.443303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.443482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.443681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.443841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.444142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.444301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.444455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.444599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.444759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.445046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.445207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.445359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.445504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.445655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.445806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.445958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.446109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.446317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.446481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.446638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.446782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.446938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.447083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.447233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.447382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.447533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.447684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.447835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.447979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.448128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.448304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.448596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.448758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.448903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.449053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.449199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.449355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.449576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.449742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.450317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.450779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.450935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.451089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.451252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.451404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.451554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.451699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 05 12:05:30.451852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.451995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.452905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.453283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.453437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.453588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.453738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.453888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.454841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.455947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.456999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.457881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.458946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.459634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.459782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.459936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.460526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.460862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.461860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.462961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.463865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.464913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.465909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466289 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.466900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.467931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.468974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.469863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.470013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.470189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.470735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.471953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.472846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.473911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.474063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.474242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.474396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.474547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.474743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.475399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.475652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.475811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.475963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.476999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.477897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.478991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.479944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.480102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.480258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.480422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.480986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.481348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.481663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.481822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.481972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.482201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.482361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.482521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.482691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.482851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.483899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.484899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.485946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.486914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.487997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.488926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.489858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.490705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.491653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.491913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.491913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.492215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.492373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.492524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.492680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.492852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.493939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.494095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.494333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.494494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.494716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.494879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.495920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.496089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.496247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.496404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.496554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.497942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.498919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.499850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.500836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.501476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.501829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.502101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.502283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.502446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.502597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.502776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.503976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.504897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.505839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.506992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.507927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.508852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.509951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.510906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.511056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.511654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.512924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.513849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.514896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.515969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.516139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.516375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.516533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.516698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.516856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.517926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.518946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.519873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.520979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.521136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.521284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.523251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.523436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.523601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.523753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.523910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.524998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.525923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.526085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.526274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.526546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.526713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.526864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.527933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.528857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.529924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530346 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.530983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.531140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.531291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.531446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.531687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.531844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.532001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.532159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.532315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.532559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.533111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.533477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.533477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.533791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.533949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.534912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.535871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.536902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.537054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.537285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.537934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.538989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.539992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.540929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.541945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.542102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.542333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.542486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.542749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.543299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.543647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.543805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.543961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.544906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.545995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.546304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.546492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.546654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.546890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.547992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.548852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.549928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.550878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.551982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.552206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.552377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.552528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.552688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.552960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.553531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.553874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.554905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.555986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.556843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.557890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.558012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.558012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.559978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.560908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.561901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.562868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.563084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.563229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.563742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.563969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.564965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.565907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.566996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.567929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.568898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.569928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.570961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.571914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.572959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.573097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.573365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.573894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.574844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.575995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.576861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.577948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.578097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.578306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.578600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.578794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.578962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.579884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.580975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.581992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.582173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.582329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.582505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.582741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.582904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.583064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.583220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.583467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.583942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.584926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.584926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.585253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.585411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.585562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.585724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.585883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.586893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.587044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.587194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.587350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.587500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.587673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.588429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.588592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.588750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.588910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.589980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.590152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.590446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.590615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.590773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.590930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.591857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.592895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.593076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.593234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.593386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.593626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.594075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.594321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.594476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.594626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.594793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.595986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.596928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.597077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.597262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.597413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.597571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.597831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.598966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.599128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.599278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.599426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.599576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.599784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.600449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.600685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.600843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.600993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.601896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.602844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.603019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.603246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.603428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.603588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.603838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.604281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.604440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.604590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.604753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.604921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.605349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.605515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.605673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.605673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.606975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.607135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.607290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.607446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.607603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.608671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.608837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609002 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.609976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.610229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.610388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.610550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.610791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.610957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.611904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.612970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.613991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.614906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.615685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.616978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.617787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.618027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.618160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.618494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.618867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.619906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.620974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.621109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.621327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.621434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.621682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.621797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.622030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.622195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.622404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.622679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.622904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.623997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.624999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.625108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.625355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.625477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.625755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.625886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.626064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.626213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.626447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.626847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.627209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.627832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.628222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.628338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.628591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.628706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.628970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.629088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.629350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.629466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.629702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.629824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.630049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.630234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.630532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.631415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.631601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.631820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.631938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.632979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.633245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.633340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.633589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.633771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.633942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.634100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.634284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.634608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.634797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.634954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.635106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.635259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.635418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.635623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.635901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.636905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.637896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.638064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.638256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.638428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.638743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.639995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.640203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.640372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.640568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.640740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.640892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.641109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.641263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.641478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.641648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.641854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.642952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.643110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.643277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.643431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.643729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.643938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.644105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.644322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.644493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.644821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.644984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.645137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.645289 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.645490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.645659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.645814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.646073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.646264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.646439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.646665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.647341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.647502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.647656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.647937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.648983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.649158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.649321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.649480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.649670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.649904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650346 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.650981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.651946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.652913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98312) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 05 12:05:30.653071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.653415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.653799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.654178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.654553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.654911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.655280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.655636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.656008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.656400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.656723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.657075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.657463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.657818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.658234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.658704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.659196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.659596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.659988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.661015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.661201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.661639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.661901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.662387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.662776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.663153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.663526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.663921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.664292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.664665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.665151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.665525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.665901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.666801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.667104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.667533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.667921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.668308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.668722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.669090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.669497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.669896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 05 12:05:30.670447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98311) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 05 12:05:30.688646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98312) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:30.711128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:30.955714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.context [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1366092d-f79f-474c-849a-63f2d02cf0e6(cell1) {{(pid=98312) load_cells /opt/stack/nova/nova/context.py:466}} Apr 05 12:05:30.962111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:05:30.963998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:05:30.964888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:05:30.967069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:05:30.982249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.context [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1366092d-f79f-474c-849a-63f2d02cf0e6(cell1) {{(pid=98311) load_cells /opt/stack/nova/nova/context.py:466}} Apr 05 12:05:30.988445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:05:30.989780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98312) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:30.991636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:05:30.992502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:05:30.994801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:05:31.004687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98312) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:31.025231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:31.026434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:31.035453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98312) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:31.062699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98311) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 05 12:05:31.122833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 12:05:31.122833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: from cryptography.utils import int_from_bytes Apr 05 12:05:31.123230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 12:05:31.123230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: from cryptography.utils import int_from_bytes Apr 05 12:05:31.150277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 12:05:31.150277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: from cryptography.utils import int_from_bytes Apr 05 12:05:31.150661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 05 12:05:31.150661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: from cryptography.utils import int_from_bytes Apr 05 12:05:31.202757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading Gnome Apr 05 12:05:31.223518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading Google Apr 05 12:05:31.227012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading Windows (alt) Apr 05 12:05:31.230317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading Gnome Apr 05 12:05:31.231750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading file Apr 05 12:05:31.233440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading keyczar Apr 05 12:05:31.233896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading multi Apr 05 12:05:31.234829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Loading pyfs Apr 05 12:05:31.251671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading Google Apr 05 12:05:31.255101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading Windows (alt) Apr 05 12:05:31.260543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading file Apr 05 12:05:31.262333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading keyczar Apr 05 12:05:31.262794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading multi Apr 05 12:05:31.263708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO keyring.backend [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Loading pyfs Apr 05 12:05:31.618977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 12:05:31.626181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 12:05:31.648714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 12:05:31.655903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 12:05:31.860276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 12:05:31.866309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-51df067c-b322-4a1e-9f4a-ffb95914afd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 12:05:31.871802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0e67fc9c0 pid: 98312 (default app) Apr 05 12:05:31.891162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 05 12:05:31.898020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WARNING keystonemiddleware.auth_token [None req-1c8d6ff2-53e3-4c60-aee3-6081378868b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 05 12:05:31.903471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0e67fc9c0 pid: 98311 (default app) Apr 05 12:06:09.500101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4301f168-fa1a-48df-a780-b768dadcbc47 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Action: 'create', calling method: .version_select at 0x7f01026cbf28>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1152999393", "metadata": {"Type": "work"}}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:09.502851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4301f168-fa1a-48df-a780-b768dadcbc47 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:09.503997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4301f168-fa1a-48df-a780-b768dadcbc47 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.466924 Apr 05 12:06:09.505124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1146 bytes} [Mon Apr 5 12:06:08 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:06:09.992540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a75fa089-6e2d-42ea-97af-38620924052c tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Action: 'create', calling method: .version_select at 0x7f01026c8b70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1867738362", "metadata": {"Type": "work"}}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:10.003788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a75fa089-6e2d-42ea-97af-38620924052c tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:10.004706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a75fa089-6e2d-42ea-97af-38620924052c tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.492961 Apr 05 12:06:10.007107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1146 bytes} [Mon Apr 5 12:06:09 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 497 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:06:10.015538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ffc851dd-063d-4987-971a-a36ad83bb7e6 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Action: 'create', calling method: .version_select at 0x7f01024829d8>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1732655772", "metadata": {"Type": "work"}}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:10.019204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ffc851dd-063d-4987-971a-a36ad83bb7e6 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:10.020053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ffc851dd-063d-4987-971a-a36ad83bb7e6 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008563 Apr 05 12:06:10.020604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1146 bytes} [Mon Apr 5 12:06:10 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:06:10.030666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f9676e27-3ee3-482f-8fa5-eb5d2c23a1b0 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Calling method '.version_select at 0x7f01024946a8>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:10.894732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-f9676e27-3ee3-482f-8fa5-eb5d2c23a1b0 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] HTTP exception thrown: Volume tempest-invalid-1870966253 could not be found. Apr 05 12:06:10.896242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f9676e27-3ee3-482f-8fa5-eb5d2c23a1b0 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 404 to user: Volume tempest-invalid-1870966253 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:10.898421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f9676e27-3ee3-482f-8fa5-eb5d2c23a1b0 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1870966253" status: 404 len: 99 microversion: 2.1 time: 0.871720 Apr 05 12:06:10.899400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1208 bytes} [Mon Apr 5 12:06:10 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1870966253 => generated 99 bytes in 873 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 05 12:06:10.909631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ab556976-2db7-43e8-8c7a-b95e5249c310 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004501 Apr 05 12:06:10.910470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1130 bytes} [Mon Apr 5 12:06:10 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 12:06:10.923139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f38c873c-ea32-4fbc-9f58-a1d579d76bcc tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005961 Apr 05 12:06:10.926845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1127 bytes} [Mon Apr 5 12:06:10 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 05 12:06:10.936398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f2df1ef7-25fa-4309-8b15-045555518355 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Calling method '.version_select at 0x7f01026cbbf8>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:11.301055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1374400090", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "fd5d83a1-0afc-4c19-a65d-89235c908427"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:11.503051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] validate_networks() for [('fd5d83a1-0afc-4c19-a65d-89235c908427', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:06:11.622147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-f2df1ef7-25fa-4309-8b15-045555518355 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] HTTP exception thrown: Volume 5b725a2e-2e70-4f08-8005-19c271ce4815 could not be found. Apr 05 12:06:11.623392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f2df1ef7-25fa-4309-8b15-045555518355 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 404 to user: Volume 5b725a2e-2e70-4f08-8005-19c271ce4815 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:11.624549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f2df1ef7-25fa-4309-8b15-045555518355 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/5b725a2e-2e70-4f08-8005-19c271ce4815" status: 404 len: 109 microversion: 2.1 time: 0.691834 Apr 05 12:06:11.625521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:06:10 2021] DELETE /compute/v2.1/os-volumes/5b725a2e-2e70-4f08-8005-19c271ce4815 => generated 109 bytes in 693 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:06:11.636899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6c050b3a-ed57-4d7a-9664-ebb9aa9b0b79 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Calling method '.version_select at 0x7f010255da60>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:11.708472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-6c050b3a-ed57-4d7a-9664-ebb9aa9b0b79 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] HTTP exception thrown: Volume 6204ce10-bcb6-4b84-a5f1-6f001586cac9 could not be found. Apr 05 12:06:11.709124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6c050b3a-ed57-4d7a-9664-ebb9aa9b0b79 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] Returning 404 to user: Volume 6204ce10-bcb6-4b84-a5f1-6f001586cac9 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:06:11.710026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6c050b3a-ed57-4d7a-9664-ebb9aa9b0b79 tempest-VolumesNegativeTest-895356723 tempest-VolumesNegativeTest-895356723-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/6204ce10-bcb6-4b84-a5f1-6f001586cac9" status: 404 len: 109 microversion: 2.1 time: 0.077935 Apr 05 12:06:11.710817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:06:11 2021] GET /compute/v2.1/os-volumes/6204ce10-bcb6-4b84-a5f1-6f001586cac9 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:06:12.916578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1062194636", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "07054388-504e-4ac2-b33c-6ef540158df3"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:13.067555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] validate_networks() for [('07054388-504e-4ac2-b33c-6ef540158df3', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:06:13.733638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:06:13.734340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:06:13.735038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:06:13.735665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:06:13.736597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:06:13.760200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:13.760696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:13.761553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:13.762032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:13.822619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Getting quotas for project a1f3610ab26944db91319f80a64eb76d. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:13.830794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Getting quotas for user 68543d297a4a4206ba1c8e88d846d798 and project a1f3610ab26944db91319f80a64eb76d. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:13.856571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:06:13.863176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:06:14.054374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0ea4ddbb-61f4-4757-9d5b-8e17508e35f2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.870914 Apr 05 12:06:14.055945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 4/9] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:06:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 2873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:06:14.071474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c17c17ec-26a5-45ae-94c1-6e11a8647849 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:14.075021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c17c17ec-26a5-45ae-94c1-6e11a8647849 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:14.324281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c17c17ec-26a5-45ae-94c1-6e11a8647849 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:14.353429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c17c17ec-26a5-45ae-94c1-6e11a8647849 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1215 microversion: 2.1 time: 0.289336 Apr 05 12:06:14.357108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:14 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:15.374829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3c2208de-bb5f-4110-8055-0689bd2db416 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:15.375483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3c2208de-bb5f-4110-8055-0689bd2db416 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:15.555503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3c2208de-bb5f-4110-8055-0689bd2db416 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:15.570288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3c2208de-bb5f-4110-8055-0689bd2db416 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1215 microversion: 2.1 time: 0.198826 Apr 05 12:06:15.570884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:15 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:16.141192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:06:16.141824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:06:16.142565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:06:16.143354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:06:16.144124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:06:16.165118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:16.171044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:16.175154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:16.176895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:16.252506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:16.270090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for user f1dcc49efc6f4a75aaf0573cb97591a7 and project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:16.316290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:06:16.320005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:06:16.502379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-05a13b93-80b6-429c-9486-4e78cf1b2461 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.768286 Apr 05 12:06:16.503077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 6/12] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:06:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 3770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:06:16.515558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2022d923-7ad3-479a-a913-ade2b65df07c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:16.516218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2022d923-7ad3-479a-a913-ade2b65df07c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:16.592713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:16.598467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:16.645332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:16.663174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:16.668855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:16.672605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:16.807749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2022d923-7ad3-479a-a913-ade2b65df07c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:16.816155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2022d923-7ad3-479a-a913-ade2b65df07c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1218 microversion: 2.1 time: 0.304458 Apr 05 12:06:16.816781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:16 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1218 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:16.877313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:16.906943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1a7c37af-8e02-48fc-ba74-4644ad4bffde tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1267 microversion: 2.1 time: 0.322188 Apr 05 12:06:16.907574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:16 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:17.834065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f2e1bca0-4d88-4b9a-8fc6-d4afd5a278e8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:17.836000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f2e1bca0-4d88-4b9a-8fc6-d4afd5a278e8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:17.925482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:17.926164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:17.942736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:17.943983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:17.948507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:17.949321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:18.122053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:18.142965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b7c06f6-2fad-4f74-9064-f8ea9d0a2e8f tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1275 microversion: 2.1 time: 0.221729 Apr 05 12:06:18.143964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:17 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:18.166362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f2e1bca0-4d88-4b9a-8fc6-d4afd5a278e8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:18.175628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f2e1bca0-4d88-4b9a-8fc6-d4afd5a278e8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1218 microversion: 2.1 time: 0.345628 Apr 05 12:06:18.176826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:17 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1218 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:19.161192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:19.162881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:19.178073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:19.182866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:19.184046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:19.185738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:19.195018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:19.196190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:19.213561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:19.214514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:19.217286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:19.219454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:19.470663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:19.491371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4d288f54-54ba-4265-9e13-7f54ed01cc82 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1222 microversion: 2.1 time: 0.302161 Apr 05 12:06:19.492004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 9/17] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:19 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:19.782462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:19.794628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f0e9e718-9bc1-4779-a250-4f364ba9cedc tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1275 microversion: 2.1 time: 0.637499 Apr 05 12:06:19.797223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:19 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1275 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:20.509507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:20.510197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:20.535896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:20.536405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:20.537997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:20.538612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:20.816869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:20.817789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:20.833278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:20.834864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:20.842049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:20.842886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:20.999038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:21.013158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-592a30be-fb8a-43eb-8f08-62a20c156962 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1222 microversion: 2.1 time: 0.508051 Apr 05 12:06:21.013807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:20 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1222 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:21.472399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:21.492885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e64545de-a314-486c-8c58-cbd65ced773b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1275 microversion: 2.1 time: 0.679784 Apr 05 12:06:21.493766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 10/20] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:20 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1275 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:22.031601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:22.032240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:22.048427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:22.054007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:22.055104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:22.055757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:22.424797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:22.454323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5295f1ce-b283-42e7-8c9c-08f41f596cc0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1214 microversion: 2.1 time: 0.426494 Apr 05 12:06:22.466476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 11/21] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:22 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1214 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:22.511627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:22.512615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:22.537441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:22.539934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:22.549626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:22.551443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:23.297425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:23.314426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-70751dfc-4bf5-4641-99ba-8e673c81e7ee tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1273 microversion: 2.1 time: 0.806975 Apr 05 12:06:23.324105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:22 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1273 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:23.473584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:23.474765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:23.495230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:23.498288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:23.501996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:23.502869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:24.341340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:24.341994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:24.361874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:24.362431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:24.374066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:24.379451 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:24.801901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:24.816771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-284cd0c1-ed6f-41ca-8c47-c039381a7f26 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1273 microversion: 2.1 time: 0.477995 Apr 05 12:06:24.817436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:24 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1273 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:25.465089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:25.507589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-857615c7-38e0-4f2e-90b6-5bd4414788f5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1276 microversion: 2.1 time: 2.024495 Apr 05 12:06:25.509373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:23 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1276 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:25.839209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:25.839981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:25.865470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:25.875458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:25.880109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:25.880918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:26.370473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:26.387412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e91036a8-91dc-4b2c-874b-24fa848e0174 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1273 microversion: 2.1 time: 0.552353 Apr 05 12:06:26.389727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:25 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1273 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:26.529104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:26.530295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:26.552099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:26.552832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:26.555104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:26.557691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:27.367735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:27.384898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7630b700-cd1c-4e5a-9f76-da6f19ee0673 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1276 microversion: 2.1 time: 0.860102 Apr 05 12:06:27.387058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:26 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1276 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:27.409923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:27.418736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:27.450385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:27.456405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:27.459583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:27.461506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:28.506630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:28.519874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-05da8d6c-f1be-4074-bdcd-962653a0b83e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.114159 Apr 05 12:06:28.527855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:27 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:28.577576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:28.578286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:28.611282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:28.630890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:28.631921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:28.632401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:28.698409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: .version_select at 0x7f01023fc7b8>, body: {"keypair": {"name": "tempest-keypair-809058030"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:28.882724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:28.896327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:29.608750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:29.624174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:29.687586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-54b459a7-2ba4-44cd-88cf-f43e4c6f3e20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.354781 Apr 05 12:06:29.688430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 14/28] 10.222.0.36 () {62 vars in 1189 bytes} [Mon Apr 5 12:06:28 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1356 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:06:29.703268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:29.704574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:29.747784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:29.748825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:29.762510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:29.762510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:30.695121 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:30.722356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aa9c2477-5027-4ecb-bcee-894ca1c0b0d7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.024666 Apr 05 12:06:30.723171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 15/29] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:29 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:30.851642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:30.864648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-62078059-379d-4287-b0f0-54848b95815a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 2.334669 Apr 05 12:06:30.869168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 15/30] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:28 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:31.229436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1025587601", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1a9fef1-3d72-4fb5-9985-c1b000ef2ea0"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:31.424071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] validate_networks() for [('a1a9fef1-3d72-4fb5-9985-c1b000ef2ea0', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:06:31.744882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:31.752244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:31.769931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:31.772203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:31.778677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:31.779796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:32.695957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:32.711129 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d868ee97-b80f-4980-b574-fdbfc266a241 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.971478 Apr 05 12:06:32.712309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 16/31] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:31 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:32.717181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:32.717840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:32.738206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:32.738732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:32.739597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:32.740702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:33.473860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:33.499443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-56ba07c7-3a64-49f0-b005-6f86a60884c6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.783041 Apr 05 12:06:33.500375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 17/32] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:32 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:33.736825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:33.736825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:33.749260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:33.749260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:33.749523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:33.750025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:34.283515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:34.305119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4349a3aa-f3f7-49ed-9d60-b778783d3373 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.577168 Apr 05 12:06:34.314881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 18/33] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:33 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:34.519312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:34.520113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:34.542242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:34.542920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:34.543528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:34.544023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:35.638027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:35.655806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3b832d29-ce09-42fb-9fb0-8cf9ae07127a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 1.141157 Apr 05 12:06:35.656678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:34 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:35.661811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:35.662617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:35.703523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:35.729410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:35.730588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:35.731102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:36.679748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:06:36.680655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:06:36.681345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:06:36.681964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:06:36.682604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:06:36.705336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:36.705336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:36.706368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:36.706506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:36.731378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Getting quotas for project b0903b4e64774f679042704eb580949d. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:36.744147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Getting quotas for user b61591d1ef834006b4b0b13c2a3efde5 and project b0903b4e64774f679042704eb580949d. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:36.787894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:06:36.791107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:06:36.882286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f5bca854-005f-4ece-b97a-092816e5d01e tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.108365 Apr 05 12:06:36.883548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 16/35] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:06:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 6111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:06:36.898296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:36.899062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:36.935696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:36.936470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:36.940191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:36.941583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:37.584226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:37.597775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db5f4b2b-a90c-4040-86f9-dcda76896cdb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.940159 Apr 05 12:06:37.603034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:35 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:37.616109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:37.617088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:37.638228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:37.638930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:37.639992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:37.640659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:37.975095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:37.993004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-32be86aa-5a32-4154-8f3d-1d6847ed5f6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1226 microversion: 2.1 time: 0.388471 Apr 05 12:06:37.993647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 21/37] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:37 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1226 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:38.256344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-9cabd1ef-0a60-4d27-b573-5b6379dec0d0 req-00a9bf70-641b-4fc8-8af0-43cf3edb7c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340a418d-96b3-4566-88fe-9f580c3f939d", "tag": "57c15950-2ba5-4a42-bb4d-ae7ef56b0248"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:38.259687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:38.259687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:38.278825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9cabd1ef-0a60-4d27-b573-5b6379dec0d0 req-00a9bf70-641b-4fc8-8af0-43cf3edb7c41 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:38.280601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9cabd1ef-0a60-4d27-b573-5b6379dec0d0 req-00a9bf70-641b-4fc8-8af0-43cf3edb7c41 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:38.351551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-9cabd1ef-0a60-4d27-b573-5b6379dec0d0 req-00a9bf70-641b-4fc8-8af0-43cf3edb7c41 service nova] Creating event network-changed:57c15950-2ba5-4a42-bb4d-ae7ef56b0248 for instance 340a418d-96b3-4566-88fe-9f580c3f939d on hv-cinder-78476 Apr 05 12:06:38.352228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9cabd1ef-0a60-4d27-b573-5b6379dec0d0 req-00a9bf70-641b-4fc8-8af0-43cf3edb7c41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98312) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 05 12:06:38.353578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:38.354248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:38.355197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:38.355761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:38.376316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.compute.rpcapi [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 05 12:06:38.388264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] Releasing lock "compute-rpcapi-router" {{(pid=98312) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 05 12:06:38.436825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1f1a6145-b5f2-408a-b065-0603b39842c0 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353960 Apr 05 12:06:38.439414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 22/38] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:06:38.446602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-168790717", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1a9fef1-3d72-4fb5-9985-c1b000ef2ea0"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:38.577092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] validate_networks() for [('a1a9fef1-3d72-4fb5-9985-c1b000ef2ea0', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:06:38.910686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:38.922584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b2b3ae86-c48c-477a-8639-7281da0674f6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 2.029254 Apr 05 12:06:38.923231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 17/39] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:36 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:38.933914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:38.934660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:38.964301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:38.964796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:38.965644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:38.966147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:39.931224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:39.941729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fe7dc42f-fe1a-42f7-a206-ae200af61e01 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.014558 Apr 05 12:06:39.946908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 18/40] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:38 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:39.960854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:39.964336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:39.980558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:39.993292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:39.994451 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:39.995085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:40.919444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:40.928985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-435b6c98-0426-475c-a6e4-fe0651bc1f5f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.980346 Apr 05 12:06:40.929636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 19/41] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:39 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:40.942986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-1a809292-20a5-4d21-99f0-abc2a505fddb req-b4d4509a-29cf-47e9-8991-cc7abf4b7c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8684743b-ae41-4c22-ab30-6d1e41e460be", "tag": "5886b48b-907c-49d7-8944-4161b3a705cb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:40.945563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:40.945563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:40.969284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1a809292-20a5-4d21-99f0-abc2a505fddb req-b4d4509a-29cf-47e9-8991-cc7abf4b7c53 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:40.969985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1a809292-20a5-4d21-99f0-abc2a505fddb req-b4d4509a-29cf-47e9-8991-cc7abf4b7c53 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.010764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-1a809292-20a5-4d21-99f0-abc2a505fddb req-b4d4509a-29cf-47e9-8991-cc7abf4b7c53 service nova] Creating event network-changed:5886b48b-907c-49d7-8944-4161b3a705cb for instance 8684743b-ae41-4c22-ab30-6d1e41e460be on hv-cinder-78476 Apr 05 12:06:41.011374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1a809292-20a5-4d21-99f0-abc2a505fddb req-b4d4509a-29cf-47e9-8991-cc7abf4b7c53 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98311) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 05 12:06:41.014804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.015320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.019506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.019506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.039734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.compute.rpcapi [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 05 12:06:41.040743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] Releasing lock "compute-rpcapi-router" {{(pid=98311) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 05 12:06:41.100820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eaeb7c75-f1c5-4e18-b231-cc2298b6385c None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169629 Apr 05 12:06:41.101523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 20/42] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:41.128053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:41.128053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:41.150317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.150822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.152184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.152184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.713856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:06:41.714768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:06:41.715874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:06:41.716794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:06:41.717450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:06:41.731231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.732420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.733968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:41.735455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:41.765935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Getting quotas for project b0903b4e64774f679042704eb580949d. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:41.772079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Getting quotas for user b61591d1ef834006b4b0b13c2a3efde5 and project b0903b4e64774f679042704eb580949d. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:41.787838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:06:41.792829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:06:41.872207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce0ff215-3e2e-41b1-a904-4b772628d54f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.430920 Apr 05 12:06:41.873074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 23/43] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:06:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:06:41.897114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c097252-f93a-4985-bdfe-d8c60294425f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:41.898509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c097252-f93a-4985-bdfe-d8c60294425f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:42.248909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c097252-f93a-4985-bdfe-d8c60294425f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:42.266259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c097252-f93a-4985-bdfe-d8c60294425f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1221 microversion: 2.1 time: 0.380260 Apr 05 12:06:42.266908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 24/44] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:41 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1221 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:42.278627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:42.279311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:42.299576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:42.302800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:42.303720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:42.304222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:42.663189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:42.674921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-106a358e-05b6-4784-b714-d280a39bc2cf tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.572085 Apr 05 12:06:42.676116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 21/45] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:41 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:42.955163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:42.968688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ac4f3a66-5ed5-41fd-a579-d5fe48522b63 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.700659 Apr 05 12:06:42.971832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 25/46] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:42 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:43.285174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:43.287428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:43.302538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:43.303301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:43.304304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:43.305585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:43.693390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:43.694118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:43.707500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:43.712307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:43.713344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:43.715598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:43.773335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:43.782996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-74993ec3-462c-4288-9b88-ed2694935af4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1281 microversion: 2.1 time: 0.501627 Apr 05 12:06:43.783876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 22/47] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:43 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1281 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:43.990629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:43.991542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:44.001264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:44.001946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:44.003044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:44.003743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:44.635551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:44.650237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a5d01bad-63f8-49c0-8cb9-1239979efc69 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.960759 Apr 05 12:06:44.662375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:43 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:44.669510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1539927669", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba2dc6d-7a10-4983-bd4a-704d4ac9411b"}], "security_groups": [{"name": "tempest-securitygroup--1444405866"}], "key_name": "tempest-keypair-809058030", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:45.024559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:45.035558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7beddd3c-3512-46a9-8618-65cf70d983a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 1.049279 Apr 05 12:06:45.037426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 23/49] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:43 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:45.050230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:45.051867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:45.062968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:45.063798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:45.064853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:45.065928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:45.135632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] validate_networks() for [('5ba2dc6d-7a10-4983-bd4a-704d4ac9411b', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:06:45.559949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:45.570590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a1842575-b3ca-49a2-bb2e-80c8822d0f35 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1279 microversion: 2.1 time: 0.531512 Apr 05 12:06:45.571209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 24/50] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:45 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1279 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:45.668719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:45.669796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:45.678459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:45.678459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:45.681124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:45.681812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.033320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:46.049989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8e619347-eabe-401f-8d90-f1efd2997d50 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.385400 Apr 05 12:06:46.054738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 25/51] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:45 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:46.066959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:46.084890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:46.096050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.096764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.097867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.098581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.741333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:46.768642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8fdd333-fa23-44f3-acde-5c7569ce8b75 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.711881 Apr 05 12:06:46.769352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 26/52] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:46 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:46.779391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:46.780833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:46.789681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.790320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.791254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.792455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.902253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:06:46.903161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:06:46.904335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:06:46.905652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:06:46.906943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:06:46.918827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.919953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.921817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:46.922545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:46.948063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:06:46.952696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:06:46.965489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:06:46.968269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:06:47.029483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-19fe758a-0f4d-4466-94cf-47af1e5ec268 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.365905 Apr 05 12:06:47.030515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 27/53] 10.222.0.36 () {62 vars in 1178 bytes} [Mon Apr 5 12:06:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 12:06:47.240685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:47.272993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b24d0edf-cb2d-4cc0-b9ae-74ef693eb09f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.499557 Apr 05 12:06:47.273828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:46 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:47.290617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:47.294713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:47.346951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-e42c28f2-e276-4cea-9e3d-2915c7ecdcfd req-a29c31c8-8b2b-4da9-a652-4b2f932fde0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c919762-cc2c-4e9f-854d-785eed7cf1df", "tag": "98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:47.350094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:47.350094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:47.363972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e42c28f2-e276-4cea-9e3d-2915c7ecdcfd req-a29c31c8-8b2b-4da9-a652-4b2f932fde0a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:47.364942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e42c28f2-e276-4cea-9e3d-2915c7ecdcfd req-a29c31c8-8b2b-4da9-a652-4b2f932fde0a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:47.384920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-e42c28f2-e276-4cea-9e3d-2915c7ecdcfd req-a29c31c8-8b2b-4da9-a652-4b2f932fde0a service nova] Creating event network-changed:98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f for instance 7c919762-cc2c-4e9f-854d-785eed7cf1df on hv-cinder-78476 Apr 05 12:06:47.391422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-e42c28f2-e276-4cea-9e3d-2915c7ecdcfd req-a29c31c8-8b2b-4da9-a652-4b2f932fde0a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359173 Apr 05 12:06:47.392358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 28/55] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:47.399704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:47.400539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:47.409874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:47.410403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:47.411439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:47.412204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:47.469758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:47.482342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:47.484112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:47.485284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b3cbdfbf-9a7c-4ee3-8663-c60106d8830e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1281 microversion: 2.20 time: 0.210401 Apr 05 12:06:47.485880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:47 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:47.725839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:47.736672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-33b677d3-af89-4906-bc4e-533aabb59507 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.342784 Apr 05 12:06:47.737757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 29/57] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:47 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:47.792069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:47.792069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:47.797047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:47.797565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:47.798432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:47.798924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.043800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:48.062299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dbebbf7f-13f4-4127-8a87-0a8eb0d363b0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.278777 Apr 05 12:06:48.062932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 29/58] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:47 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:48.291644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:48.292315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:48.304594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.305457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.306589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.307151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.508223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:48.508933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:48.520086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.521428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.523003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.523500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.574969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:48.585367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e3e9ec83-214c-47be-94d2-6513b26f75dc tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.298005 Apr 05 12:06:48.586307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 30/59] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:48 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:48.669403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:48.679278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:48.681166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:48.682711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-25492f0a-dfb9-4ba5-8999-c616dea4a91a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1285 microversion: 2.20 time: 0.178673 Apr 05 12:06:48.683338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 30/60] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:48 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:48.754329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:48.755500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:48.763375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.764313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:48.765368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:48.766040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.011172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:49.020864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ec88dce7-5b2b-4c2c-8352-8545a9ad2fb3 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.270283 Apr 05 12:06:49.022736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 31/61] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:48 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:49.080546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:49.081440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:49.090904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.091832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.093102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.093884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.606271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:49.607319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:49.626094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.626744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.632570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:49.644143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.646105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.652132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-29e350dd-12f9-4962-b8ec-ea35197b96e6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.575699 Apr 05 12:06:49.656715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 31/62] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:49 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:49.704305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:49.705233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:49.723799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.724692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:49.726784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:49.727453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:50.556835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:50.574069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:50.576010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:50.580890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2de25d4e-9cf0-44da-a38d-9434bfe4974c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1333 microversion: 2.20 time: 0.881645 Apr 05 12:06:50.581825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 32/63] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:49 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1333 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:06:50.611361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:50.616340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:50.634728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:50.636855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:50.637866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:50.639804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:50.744700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:50.761007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4da68e2d-eae8-4107-9abb-401b7c1db9a1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 1.161810 Apr 05 12:06:50.771684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 32/64] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:49 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:50.776983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:50.777583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:50.801368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:50.802304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:50.803561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:50.804068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:51.571449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:51.596089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b152d8a0-6faf-48b0-bed4-b49bf1e5c987 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.823081 Apr 05 12:06:51.597050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 33/65] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:50 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:51.608899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:51.609573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:51.640856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:51.642342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:51.647692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:51.649166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:51.946705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:51.965053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:51.971900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:51.975244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e6268b9b-03af-49c0-9b74-1f071ad3169f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1339 microversion: 2.20 time: 0.373704 Apr 05 12:06:51.976038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:51 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1339 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:51.985775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:51.989929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:51.999711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:52.004950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-549ceb3b-87ba-498d-97de-ec73d9a7e0fa tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 1.408999 Apr 05 12:06:52.008395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 33/67] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:50 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:52.022960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:52.023820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:52.026641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:52.027985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:52.420852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:52.431493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bb4962b0-9cf0-44b0-91fa-1546f2611a74 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.451828 Apr 05 12:06:52.432299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 35/68] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:51 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:52.614973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:52.615820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:52.627945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:52.628850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:52.630460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:52.631838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:52.648790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-9d87d5f0-e103-4e93-8032-a3097d62bf64 req-a5f8f4b6-dc73-4cb1-99b4-0ec39280f60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1", "tag": "245fb830-1f01-4e19-b34c-4fcae22ec0c3"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:52.651549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:52.651549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:52.668257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9d87d5f0-e103-4e93-8032-a3097d62bf64 req-a5f8f4b6-dc73-4cb1-99b4-0ec39280f60f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:52.674622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9d87d5f0-e103-4e93-8032-a3097d62bf64 req-a5f8f4b6-dc73-4cb1-99b4-0ec39280f60f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:52.709328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-9d87d5f0-e103-4e93-8032-a3097d62bf64 req-a5f8f4b6-dc73-4cb1-99b4-0ec39280f60f service nova] Creating event network-changed:245fb830-1f01-4e19-b34c-4fcae22ec0c3 for instance 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 on hv-cinder-78476 Apr 05 12:06:52.719631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-9d87d5f0-e103-4e93-8032-a3097d62bf64 req-a5f8f4b6-dc73-4cb1-99b4-0ec39280f60f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075391 Apr 05 12:06:52.722731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 36/69] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:06:53.001709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:53.002571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:53.013222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.013991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.015102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.015607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.032771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.061194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0dd21b0c-ae12-4fd0-90c2-d523b5a03058 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.450765 Apr 05 12:06:53.064876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 34/70] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:52 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:53.076997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:53.077687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:53.095867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.096308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.097169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.097667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.373176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.389169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.392174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.393512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2bb24305-f46e-479e-8cb0-beb02f1b8188 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.398618 Apr 05 12:06:53.394585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 37/71] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:52 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:53.449504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:53.450183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:53.466746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.467270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.468140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:53.478937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:53.525824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.553531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1710b186-f7c1-4c18-8307-6436df1a6f62 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.487279 Apr 05 12:06:53.554517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:53 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:53.797019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:53.809716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d3ac709b-87de-4d98-84e1-db13650b6720 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.364093 Apr 05 12:06:53.822812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:53 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:54.083509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:54.084472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:54.093382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.093964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.094861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.095357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.323489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:54.332457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-479a8cbf-2410-43d1-af33-ff1ec245c05c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.254235 Apr 05 12:06:54.333584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 36/74] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:54 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:54.413905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:54.414648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:54.422446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.422954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.423797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.424285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.572191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:54.573231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:54.581683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.582244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.583156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.583679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.649751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:54.659787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:54.662156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:54.663502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f0fe8f70-07f4-4458-8acf-542cd4ce46d1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.253711 Apr 05 12:06:54.664042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 39/75] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:54 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:54.800118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:54.810465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-05a4e291-768e-49a4-828f-644ed9e13880 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.242920 Apr 05 12:06:54.811097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 37/76] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:54 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:54.829083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:54.830185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:54.839057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.839566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:54.840408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:54.840898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.058321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:55.067273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e29c9f5a-6683-4517-a6a2-41fc1644a64a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.242210 Apr 05 12:06:55.068592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 40/77] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:54 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:55.351097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:55.351775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:55.359490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.359997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.360875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.361369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.572454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:55.581282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-975f1c17-06e7-4466-b401-79cd937d47da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.235038 Apr 05 12:06:55.581907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 38/78] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:55 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:55.683371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:55.684220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:55.692497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.693279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.694237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.694827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.829243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:55.829969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:55.838620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.839130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.839968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:55.840506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:55.917938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:55.927815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:55.929512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:55.930737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4da40afe-4c31-4c53-8b9c-be51ab866ed6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.251604 Apr 05 12:06:55.931407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 41/79] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:55 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:56.060837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:56.070662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b855961b-770b-492a-ad30-fce946ecf918 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.245488 Apr 05 12:06:56.071330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:55 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:56.087481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:56.088162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:56.096108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.096619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:56.097469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.097960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:56.329811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:56.339983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7e34e6c6-7138-440e-aa2b-6001413d04ff tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.257765 Apr 05 12:06:56.340614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 42/81] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:56 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:56.599656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:56.600406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:56.608482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.608990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:56.609829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.610421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:56.949908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:56.950576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:56.958584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.959246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:56.960152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:56.960640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:57.181776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:57.195557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:57.197218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:57.198431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-698a36a7-e6f6-46ff-ad7c-a384fb3a5575 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.252756 Apr 05 12:06:57.199220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 43/82] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:56 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:06:57.216104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:57.216777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:57.234359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:57.234874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:57.235732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:57.236226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:57.447333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:57.459729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-295c411d-ff65-4d54-8a9e-004bc84cebb9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.863844 Apr 05 12:06:57.471183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 40/83] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:56 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:57.477482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:57.478594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:57.488342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:57.490216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:57.490933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:57.492429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:57.493115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:57.499936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-21cc4684-a849-4bcf-affe-ebe4bb78efec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.292460 Apr 05 12:06:57.501051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 44/84] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:57 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:58.217217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:58.217810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:58.226645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.227339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.228314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.228953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.230497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:58.243854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c3694b9c-4349-45e3-8bc7-24f9a701f77c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.770450 Apr 05 12:06:58.244678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:57 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:58.492668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:58.493599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:58.504089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.505360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.506530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.507205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.510810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:58.531225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:58.533286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:58.542158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ad2fcd65-46db-408d-b364-ff861a0af1e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.328615 Apr 05 12:06:58.542922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 45/86] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:58 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:58.558649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:58.559440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:58.570715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.571238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.572373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:58.573170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:58.825338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:58.834212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2cbab436-4cdc-4fc7-a90f-e4dce73ce624 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.290134 Apr 05 12:06:58.846937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 46/87] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:58 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:06:59.015284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:59.027579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e7f6f2c2-1424-484e-b21e-bdcddb6225bb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.550681 Apr 05 12:06:59.028652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 42/88] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:58 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:06:59.033834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-eebb795c-2082-42ad-b40d-4a25a8603dde req-caf9b940-683b-4a6f-97c3-924dc609bcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:59.036889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:59.036889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:59.053458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-1c3eb0db-f43a-43b7-b47f-ac03ce7068ae req-04be7170-fa84-43c4-b959-667a5f1d8e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8684743b-ae41-4c22-ab30-6d1e41e460be", "name": "network-vif-plugged", "status": "completed", "tag": "5886b48b-907c-49d7-8944-4161b3a705cb"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:06:59.060169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:06:59.060169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:06:59.065569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-eebb795c-2082-42ad-b40d-4a25a8603dde req-caf9b940-683b-4a6f-97c3-924dc609bcf7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.066540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-eebb795c-2082-42ad-b40d-4a25a8603dde req-caf9b940-683b-4a6f-97c3-924dc609bcf7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.080054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1c3eb0db-f43a-43b7-b47f-ac03ce7068ae req-04be7170-fa84-43c4-b959-667a5f1d8e85 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.083394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1c3eb0db-f43a-43b7-b47f-ac03ce7068ae req-04be7170-fa84-43c4-b959-667a5f1d8e85 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.090747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-eebb795c-2082-42ad-b40d-4a25a8603dde req-caf9b940-683b-4a6f-97c3-924dc609bcf7 service nova] Creating event network-changed:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:06:59.114789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-eebb795c-2082-42ad-b40d-4a25a8603dde req-caf9b940-683b-4a6f-97c3-924dc609bcf7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083935 Apr 05 12:06:59.119131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 43/89] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:59.141569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-1c3eb0db-f43a-43b7-b47f-ac03ce7068ae req-04be7170-fa84-43c4-b959-667a5f1d8e85 service nova] Creating event network-vif-plugged:5886b48b-907c-49d7-8944-4161b3a705cb for instance 8684743b-ae41-4c22-ab30-6d1e41e460be on hv-cinder-78476 Apr 05 12:06:59.168579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-1c3eb0db-f43a-43b7-b47f-ac03ce7068ae req-04be7170-fa84-43c4-b959-667a5f1d8e85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230630 Apr 05 12:06:59.169497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 47/90] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:06:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:06:59.265999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:59.267093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:59.287744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.288259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.295223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.297061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.566417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:59.567745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:59.578507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.580321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.581790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.583793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.877347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:59.888416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:59.890366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:06:59.891884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b2418c4-e1f4-42e8-b56f-2d385f1d3c27 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.332623 Apr 05 12:06:59.892695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 48/91] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:06:59 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:06:59.910900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:06:59.911676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:06:59.920919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.921428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:06:59.922332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:06:59.922821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:00.068786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:00.080220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-78049eae-02b5-43af-b253-2aa00c91fb51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.822436 Apr 05 12:07:00.081794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 44/92] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:59 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:00.088718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:00.089810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:00.107679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:00.108389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:00.109386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:00.110479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:00.182523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:00.193504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6023bcd1-893d-4d39-8ff9-d6561d2dc1bb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.287040 Apr 05 12:07:00.194160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 49/93] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:06:59 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:00.613317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:00.622229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6150277d-8eca-4b8c-9cd1-e73bcad91052 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.538264 Apr 05 12:07:00.622845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 45/94] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:00 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:00.913964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:00.914939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:00.922667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:00.923466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:00.924420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:00.925113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.112665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:01.113574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:01.129653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.134542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.135537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.138593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.186975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.200098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.208188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.209412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-301e1a3f-c7e1-4baf-846e-8492562834ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.299825 Apr 05 12:07:01.210044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 50/95] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:00 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:01.225327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:01.226012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:01.244432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.244882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.245730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.246247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.453403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.462821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-93f3081e-e91b-401d-90f0-d48089cb19a4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.361182 Apr 05 12:07:01.463434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 46/96] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:01 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:01.468736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-e89cb9c9-227e-45a1-80e5-b93b6efb0d01 req-c3e104eb-f3f0-4ba8-ac60-0fbc64c1ccfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a418d-96b3-4566-88fe-9f580c3f939d", "name": "network-vif-plugged", "status": "completed", "tag": "57c15950-2ba5-4a42-bb4d-ae7ef56b0248"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:01.470632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:01.470632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:01.480249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e89cb9c9-227e-45a1-80e5-b93b6efb0d01 req-c3e104eb-f3f0-4ba8-ac60-0fbc64c1ccfd service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.480724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e89cb9c9-227e-45a1-80e5-b93b6efb0d01 req-c3e104eb-f3f0-4ba8-ac60-0fbc64c1ccfd service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.490336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.498616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-57dc759b-e7d1-4c21-8876-58dcaf864864 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.287407 Apr 05 12:07:01.499129 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-e89cb9c9-227e-45a1-80e5-b93b6efb0d01 req-c3e104eb-f3f0-4ba8-ac60-0fbc64c1ccfd service nova] Creating event network-vif-plugged:57c15950-2ba5-4a42-bb4d-ae7ef56b0248 for instance 340a418d-96b3-4566-88fe-9f580c3f939d on hv-cinder-78476 Apr 05 12:07:01.499265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 51/97] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:01 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:01.505081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-e89cb9c9-227e-45a1-80e5-b93b6efb0d01 req-c3e104eb-f3f0-4ba8-ac60-0fbc64c1ccfd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039996 Apr 05 12:07:01.505728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 47/98] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:01.640966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:01.641633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:01.649891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.650232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.651073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:01.651556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:01.871184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:01.879951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-982e7caf-ccab-47cf-b365-bcddcec524cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.242968 Apr 05 12:07:01.880552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 52/99] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:01 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:02.229596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:02.230388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:02.238388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.238897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.239915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.240409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.479683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:02.480953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:02.481821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:02.489800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:02.490465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.490993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.491510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:02.491824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.492319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.492715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-37491f07-c418-4057-adcf-e0c78b276fae tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.267650 Apr 05 12:07:02.493332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 48/100] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:02 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:02.516605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:02.517252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:02.525574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.526283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.527123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.527595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.711725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:02.720635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f68ac73e-1a8e-40cd-b6e1-801e124d65e8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.243969 Apr 05 12:07:02.721264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 53/101] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:02 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:02.739960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:02.748673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-39ea010f-afac-4f62-9457-df12127ccb00 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.235930 Apr 05 12:07:02.749286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 49/102] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:02 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:02.897247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:02.898234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:02.905959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.906495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:02.907324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:02.907808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.124619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:03.133520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-36ce11d6-3ed6-40cd-b4e4-f82b6be200a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.240409 Apr 05 12:07:03.134197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 54/103] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:02 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:03.511562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:03.512224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:03.519944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.521097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.521929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.526328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.737948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:03.739155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:03.739839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:03.747577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.747731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:03.748080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.748916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.749373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:03.749492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.750547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b8429d2f-c80e-48e1-9bc3-0ab40b44ed7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.242890 Apr 05 12:07:03.751164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 50/104] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:03 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:03.774917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:03.775587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:03.783365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.783870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.784698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:03.785181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:03.965848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:03.974951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-17bc0e8d-06b6-4586-bd2f-d392db08c60f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.240312 Apr 05 12:07:03.975669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 55/105] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:03 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:03.997996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:04.007447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10a72fb5-2fee-4126-8777-828566dc2f3e tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.242718 Apr 05 12:07:04.008066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 51/106] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:03 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:04.152028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:04.152771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:04.160994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:04.161547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:04.162479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:04.163024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:04.371598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:04.380873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5b6f881b-05f2-4ebd-a670-ddd08da588cc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.233153 Apr 05 12:07:04.381509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 56/107] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:04 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:04.773798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:04.774523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:04.782701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:04.783205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:04.784043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:04.784526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:04.993021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:04.993359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:04.993687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:05.001361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.001857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.002710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.003036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:05.003171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.004711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:05.005877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-027620dd-9fca-44a0-ab0d-ef5fc6ee97c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.236920 Apr 05 12:07:05.006556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 52/108] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:04 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:05.025519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:05.026409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:05.034114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.034659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.035532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.036184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.223084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:05.232084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0feed481-f09b-4435-a01d-ed71bbba3baa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.243126 Apr 05 12:07:05.232750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 57/109] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:04 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:05.264647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:05.274315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d13d109e-9aac-43f5-a9f7-92459364ff4b tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.253421 Apr 05 12:07:05.274936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 53/110] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:05 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:05.399392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:05.400061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:05.407804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.408312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.409137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:05.409630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:05.619539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:05.628410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-af54b039-9569-4c1e-b83b-cf9335b48121 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.233872 Apr 05 12:07:05.629026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 58/111] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:05 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:06.025265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:06.025932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:06.034219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.034731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.035573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.036602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.250143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:06.250824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:06.258792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.259296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.260127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.260610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.477570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.486934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9bea515e-eb2e-46a4-a04c-647e8faae714 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.240734 Apr 05 12:07:06.487567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 59/112] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:06 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:06.492445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:06.494513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:06.502226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.502730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.503568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.504054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.528897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.543309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.545724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.547204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-196e7f84-15aa-4bb8-ba05-aa85ac943d7d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.526243 Apr 05 12:07:06.549113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 54/113] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:06 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:06.649051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:06.649332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:06.658327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.658839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.659698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:06.660191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:06.775894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.796245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b38a460-ae64-43dc-8906-d534462a5cf2 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.307466 Apr 05 12:07:06.797091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 60/114] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:06 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:06.909242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:06.918745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b7ca30cb-d619-4c0e-915d-1b2f169e97bc tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.275880 Apr 05 12:07:06.919606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 55/115] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:06 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:07.505062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:07.505727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:07.513556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.514063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.514923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.515413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.566921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:07.567597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:07.575221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.575719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.576554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.577048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.802836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:07.812928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:07.814775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:07.816056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc30ca4a-6ec9-4380-8a25-7985ff564999 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.253207 Apr 05 12:07:07.816726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 56/116] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:07 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:07.822429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:07.823147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:07.831283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.831819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.832720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.833253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.928956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:07.947443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-209fd759-9b4f-4da6-89d1-f27a938cf733 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.446384 Apr 05 12:07:07.948058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 61/117] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:07 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:07.956959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:07.957620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:07.966143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.966795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:07.967635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:07.968124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:08.076482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:08.085736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bbc58bde-cc68-4688-83a4-2c7b9b9b6c24 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.267096 Apr 05 12:07:08.086404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 57/118] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:07 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:08.195806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:08.205078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-09674bab-9d45-4680-87ce-3f46616aff0c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.255840 Apr 05 12:07:08.205741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 62/119] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:07 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:08.836108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:08.836700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:08.844490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:08.844996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:08.845833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:08.846349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:08.965088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:08.965754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:08.975106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:08.975106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:08.975368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:08.975760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:09.070727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.080209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.081855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.083071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-93188ed2-dda3-434b-8ff3-20dd8d0ddac5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.251306 Apr 05 12:07:09.083696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 58/120] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:08 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:09.104209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:09.105122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:09.116773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:09.117465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:09.118526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:09.119185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:09.213619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.222481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5de89102-74af-4b35-8f36-3d2ed2425f30 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.261304 Apr 05 12:07:09.223108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 63/121] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:08 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:09.228709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:09.229367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:09.236877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:09.237375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:09.238241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:09.238734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:09.371065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.381333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-98fad568-a7a2-4cc8-8a1a-b14ee035e0f7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.280485 Apr 05 12:07:09.391694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 59/122] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:09 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:09.456779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:09.465829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-283a92bf-8a8c-4a0e-8280-58ba37b13e85 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.241698 Apr 05 12:07:09.466653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 64/123] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:09 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:10.105813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:10.107894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:10.115705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.116320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.117353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.117912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.241226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:10.241921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:10.249748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.250284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.251117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.251606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.336710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.346730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.348493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.349661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-38ad1301-dda9-4a25-869f-3c854632541c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.250139 Apr 05 12:07:10.350592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 60/124] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:10 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:10.400209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:10.400933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:10.409022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.409572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.410491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.411018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.472888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.482117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-daacc49b-7ef8-4c89-b598-8b1a9563d651 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.244993 Apr 05 12:07:10.482797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 65/125] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:10 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:10.487394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:10.488056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:10.495744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.496250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.497109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:10.497574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:10.625561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.635008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24eb0b50-7c9a-4b44-aedc-c715a340940c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.239902 Apr 05 12:07:10.635636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 61/126] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:10 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:10.706199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:10.715059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d367791-3ffa-4fe5-ab14-a1a78df82753 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.231249 Apr 05 12:07:10.715695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 66/127] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:10 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:11.369511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:11.370410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:11.379181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.379685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.380578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.381044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.499925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:11.500588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:11.508568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.509071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.510076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.510594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.598985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.609086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.610774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.611914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23fe0d48-420e-4d2c-9354-cd899139a1e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.247476 Apr 05 12:07:11.612523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 62/128] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:11 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:11.654250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:11.655032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:11.663153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.663670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.664669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.665166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.724267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.733029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2c3fa832-98db-40a9-b3a8-d94d47085b19 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.237100 Apr 05 12:07:11.733654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 67/129] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:11 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:11.738259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:11.738916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:11.746994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.747499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.748330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:11.748816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:11.881420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.890869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0077c641-08c6-4bf9-8c43-d64929bd43b8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.240652 Apr 05 12:07:11.892500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 63/130] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:11 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:11.970585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:11.981013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fae839dc-cdd9-4134-8e93-16a443428279 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.246280 Apr 05 12:07:11.981649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 68/131] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:11 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:12.632444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:12.633624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:12.642298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:12.642548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:12.643584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:12.644175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:12.750747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:12.751509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:12.760922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:12.761734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:12.763287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:12.763961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.073840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.083707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-092708cb-083c-4304-93cd-9c2417615843 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.336752 Apr 05 12:07:13.084966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 69/132] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:12 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:13.090818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:13.091487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:13.100482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:13.100972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.101984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:13.102846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.153083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.163923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.165608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.166830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24fc9a5f-648d-4e87-8ad0-a86751079ec2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.539857 Apr 05 12:07:13.167455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 64/133] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:12 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:13.172210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:13.172876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:13.181226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:13.181735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.182629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:13.183119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.502318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.512018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fa4d1276-93e4-448f-bb81-91c85dbf86fa tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1318 microversion: 2.1 time: 0.343307 Apr 05 12:07:13.522049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 65/134] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:13 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:13.741611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:13.755365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-761ff990-81a9-4ee5-9759-d8628b4b7dc7 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1315 microversion: 2.1 time: 0.668530 Apr 05 12:07:13.759177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 70/135] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:13 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:13.900597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-daa44fc3-7135-4755-a38b-a0b4bd8b075e req-53e6eff5-4cc7-4f61-91dc-ac6a01ee0b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c919762-cc2c-4e9f-854d-785eed7cf1df", "name": "network-vif-plugged", "status": "completed", "tag": "98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:13.904074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:13.904074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:13.935608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-daa44fc3-7135-4755-a38b-a0b4bd8b075e req-53e6eff5-4cc7-4f61-91dc-ac6a01ee0b49 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:13.936149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-daa44fc3-7135-4755-a38b-a0b4bd8b075e req-53e6eff5-4cc7-4f61-91dc-ac6a01ee0b49 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:13.968921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-daa44fc3-7135-4755-a38b-a0b4bd8b075e req-53e6eff5-4cc7-4f61-91dc-ac6a01ee0b49 service nova] Creating event network-vif-plugged:98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f for instance 7c919762-cc2c-4e9f-854d-785eed7cf1df on hv-cinder-78476 Apr 05 12:07:13.986148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-daa44fc3-7135-4755-a38b-a0b4bd8b075e req-53e6eff5-4cc7-4f61-91dc-ac6a01ee0b49 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090633 Apr 05 12:07:13.988708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 66/136] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:14.112153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:14.120197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:14.143895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.143895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.150256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.152614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.189664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:14.191169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:14.208736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.216134 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.217787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.218507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.464004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:14.474374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0ba99365-24db-48aa-b049-3303ec4241e9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.366880 Apr 05 12:07:14.476550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 71/137] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:14 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:14.530305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:14.531691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:14.541902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.542776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.543953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.544649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.656664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:14.667952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:14.670000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:14.671433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6feb7685-00f4-496c-a4a3-caa76c6d9c61 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.486976 Apr 05 12:07:14.674164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 67/138] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:14 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:14.776344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:14.777947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:14.786634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.788358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.789602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:14.790262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:14.823952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:14.836053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-862d7471-aebe-4139-8911-31115738ca6c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1508 microversion: 2.1 time: 0.310376 Apr 05 12:07:14.836958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 72/139] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:14 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:15.083738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:15.094031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-43b1f0de-a0df-4f2f-ac57-136cd923814c tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1502 microversion: 2.1 time: 0.322803 Apr 05 12:07:15.094684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 68/140] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:14 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:15.493307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:15.498066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:15.509357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:15.509870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:15.510775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:15.511270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:15.692898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:15.694860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:15.703748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:15.704392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:15.705243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:15.705733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:15.787831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:15.799871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-97eb84a7-9ac7-49be-9ea2-4382ab153548 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.310663 Apr 05 12:07:15.800687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 73/141] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:15 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:15.938433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:15.949819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:15.951605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:15.952806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2121da4e-a139-4ef0-b04e-127da976705a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.264929 Apr 05 12:07:15.953631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 69/142] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:15 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:16.818168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:16.819738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:16.827476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:16.827977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:16.828814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:16.829278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:16.872009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-08d8becc-8a0e-4a81-9fda-ea073df561d2 req-857ceee8-2f41-48b3-8cc3-78e70dfdb452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1", "name": "network-vif-plugged", "status": "completed", "tag": "245fb830-1f01-4e19-b34c-4fcae22ec0c3"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:16.875876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:16.875876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:16.886031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-08d8becc-8a0e-4a81-9fda-ea073df561d2 req-857ceee8-2f41-48b3-8cc3-78e70dfdb452 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:16.886429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-08d8becc-8a0e-4a81-9fda-ea073df561d2 req-857ceee8-2f41-48b3-8cc3-78e70dfdb452 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:16.907519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-08d8becc-8a0e-4a81-9fda-ea073df561d2 req-857ceee8-2f41-48b3-8cc3-78e70dfdb452 service nova] Creating event network-vif-plugged:245fb830-1f01-4e19-b34c-4fcae22ec0c3 for instance 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 on hv-cinder-78476 Apr 05 12:07:16.914657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-08d8becc-8a0e-4a81-9fda-ea073df561d2 req-857ceee8-2f41-48b3-8cc3-78e70dfdb452 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047047 Apr 05 12:07:16.915449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 70/143] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:16.978725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:16.979468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:16.994804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:16.995315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:16.996165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:16.996662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:17.064246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:17.074689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-25178c04-6fe7-4bc5-8f73-a14c4b92805c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.260365 Apr 05 12:07:17.075303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 74/144] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:16 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:17.221395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:17.231105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:17.232769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:17.233922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9680a58f-e512-424a-b3b3-cfa5c46b81e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.261085 Apr 05 12:07:17.234800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 71/145] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:16 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:18.092917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:18.093566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:18.102025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:18.102550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:18.103421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:18.103914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:18.253512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:18.254750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:18.262300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:18.262810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:18.263647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:18.264326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:18.319026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:18.327797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9a3041b1-40c8-4fef-a0c8-cc19ae7e9ef7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.238914 Apr 05 12:07:18.328409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 75/146] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:18 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:18.484337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:18.493876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:18.495608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:18.496759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4ac580bf-9559-4996-9f8a-b1477d16f056 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.247608 Apr 05 12:07:18.497381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 72/147] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:18 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:07:19.346893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:19.347651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:19.357347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:19.357928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:19.358889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:19.359586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:19.515999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:19.516664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:19.524925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:19.525430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:19.526301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:19.526794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:19.594535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:19.604260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c37cf839-d1e5-40da-b59c-205cc407b540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.261913 Apr 05 12:07:19.604898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 76/148] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:19 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:19.782231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:19.792113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:19.793839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:19.795042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-75a67dcd-ff71-4d2d-bae1-6bc281166cbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.283022 Apr 05 12:07:19.795561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 73/149] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:19 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:07:20.622149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:20.622836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:20.630641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:20.631694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:20.632523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:20.633015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:20.814702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:20.815421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:20.823800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:20.824485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:20.825378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:20.825998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:20.857426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:20.868636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-de8d2593-83ab-4a28-bd1b-1ea93676625d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1321 microversion: 2.1 time: 0.250424 Apr 05 12:07:20.869271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 77/150] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:20 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:21.024112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1e1f8c-c3e7-4484-89c6-612f180297f3"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:21.025593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:21.034555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:21.035285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:21.036325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:21.037597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:21.085508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:21.097472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:21.099225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:21.101088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b06fde70-16db-4723-8cb8-8fdaec30ba48 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.290651 Apr 05 12:07:21.101722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 74/151] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:20 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:07:21.614376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5064c0cd-9433-4a0f-ac21-a629f7b98351 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594273 Apr 05 12:07:21.615101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 78/152] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:07:21 2021] POST /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:21.885726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:21.886521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:21.894656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:21.895171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:21.896010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:21.897042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.122175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:22.122983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:22.133239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.133759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.134659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.135135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.242728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:22.251510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aaf34cd7-172f-4793-a8d7-6e1acfee0c2f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1514 microversion: 2.1 time: 0.369923 Apr 05 12:07:22.252117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 75/153] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:21 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:22.270013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:22.271180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:22.282651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.282651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.282651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.282651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.347483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lazy-loading 'flavor' on Instance uuid 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:07:22.378594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:22.389135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:22.391589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:22.393171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4cd4c191-a122-4701-8fae-00c2764eee0c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.276079 Apr 05 12:07:22.394827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 79/154] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:22 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:07:22.401331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f80e1737-0e63-49ca-ab62-781f3834ed6f"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:22.402833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:22.414777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.414777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.414777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.416971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.517337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b3705f6f-261f-458e-b6e9-ef55245fd5a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1/action" status: 200 len: 32 microversion: 2.1 time: 0.251342 Apr 05 12:07:22.518179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 76/155] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:07:22 2021] POST /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 12:07:22.532315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:22.533132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:22.542578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.543110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.543974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:22.544449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:22.951455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:22.963877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9f7daec3-8580-4407-8bfc-1fa18e21b8a3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.438846 Apr 05 12:07:22.965373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 77/156] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:22 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:22.983886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-47bec144-635f-4d02-b5ff-d5b9e7d94312 req-26771180-715b-4acb-ae47-43dc3cf60b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "name": "network-vif-plugged", "status": "completed", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:22.985625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:22.985625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:22.999406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-47bec144-635f-4d02-b5ff-d5b9e7d94312 req-26771180-715b-4acb-ae47-43dc3cf60b67 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:23.000248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-47bec144-635f-4d02-b5ff-d5b9e7d94312 req-26771180-715b-4acb-ae47-43dc3cf60b67 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:23.020769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-47bec144-635f-4d02-b5ff-d5b9e7d94312 req-26771180-715b-4acb-ae47-43dc3cf60b67 service nova] Creating event network-vif-plugged:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:07:23.027897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-47bec144-635f-4d02-b5ff-d5b9e7d94312 req-26771180-715b-4acb-ae47-43dc3cf60b67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060566 Apr 05 12:07:23.029067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 78/157] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:23.289680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d899106-285b-4c79-9367-a684773c9128 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "POST /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892793 Apr 05 12:07:23.301692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 80/158] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:07:22 2021] POST /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:23.420430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:23.421361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:23.445464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:23.445985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:23.446901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:23.447394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:23.986358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:23.988020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:24.000486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:24.001628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:24.003867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:24.004978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:24.157431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:24.170705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:24.172497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:24.174057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6af9d150-b1ee-44df-b85f-8174598f7d55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.763878 Apr 05 12:07:24.174710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 79/159] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:23 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:24.326697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:24.335807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-693a6d6d-20df-4b54-83d3-825e99940e1d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.355424 Apr 05 12:07:24.336694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 81/160] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:23 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:25.195426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:25.196085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:25.204459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:25.204967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:25.205805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:25.206340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:25.355277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:25.356120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:25.365801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:25.366653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:25.367778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:25.368359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:25.430169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:25.440381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:25.442048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:25.444012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a0169940-96dd-4396-aa6f-e475452e8bec tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.253925 Apr 05 12:07:25.444765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 80/161] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:25 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:25.669839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:25.679846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cfdb9ea6-0aad-4532-b39d-cab18f6a8c0b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.330008 Apr 05 12:07:25.680464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 82/162] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:25 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:26.464318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:26.465131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:26.472887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:26.473403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:26.474271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:26.475092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:26.688979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:26.697509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:26.698619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:26.700042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:26.701704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:26.703107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6daccf9a-bb0e-46dd-8cbd-62e9f11fe244 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.243664 Apr 05 12:07:26.703896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 81/163] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:26 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:26.714375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:26.714375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:26.714375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:26.714375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:26.932683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:26.943638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a9f59fe2-4662-49fb-b630-3e696f4d2649 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.250592 Apr 05 12:07:26.944714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 83/164] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:26 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:27.723576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:27.724243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:27.731987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:27.732492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:27.733316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:27.733798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:27.952166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:27.961139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:27.961826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:27.961958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:27.963513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:27.964663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc8030b9-92ad-4a90-bfdf-629e69db121e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.245194 Apr 05 12:07:27.965278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 82/165] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:27 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:27.969686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:27.970218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:27.971062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:27.971626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:28.185498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:28.195088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-585c0204-a8b9-4c3c-8468-cfc41c81d884 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.238096 Apr 05 12:07:28.195708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 84/166] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:27 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:28.983873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:28.984534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:28.992490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:28.993036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:28.993868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:28.994431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:29.214327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:29.214767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:29.215291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:29.223251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:29.223848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:29.224320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:29.225280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:29.225778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:29.225984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:29.227164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-085eea7b-27bb-405c-8086-6e2b9d5a1304 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.247422 Apr 05 12:07:29.227780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 83/167] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:28 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:29.478014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:29.487325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-05530eda-6a2e-4a6a-8c8f-37e9710ead7d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.278441 Apr 05 12:07:29.487955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 85/168] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:29 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:30.246604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:30.247540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:30.255273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:30.256385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:30.257239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:30.257723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:30.466211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:30.475503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:30.477151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:30.478324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8e360cd-2ffd-4304-9713-e867ed1c8e3c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1407 microversion: 2.20 time: 0.235838 Apr 05 12:07:30.480790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 84/169] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:30 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:30.504983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:30.506416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:30.514089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:30.514836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:30.515835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:30.516475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:30.744311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:30.756132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-00ce8947-bbaf-43d2-bc92-56a14f0cc528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.254536 Apr 05 12:07:30.767967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 86/170] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:30 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:31.499827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:31.500490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:31.508482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:31.508983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:31.509809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:31.510323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:31.732598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:31.744150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:31.745836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:31.747221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c474f84e-e821-4fd5-a6a7-08040e237fe7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1599 microversion: 2.20 time: 0.251329 Apr 05 12:07:31.748014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 85/171] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:07:31 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1599 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:31.764066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-850343800", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:31.766523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:31.767100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:31.777097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:31.778914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:31.778914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:31.786608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:31.838008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] validate_networks() for None {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:07:32.019804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1160d0bc-0970-43d2-b3ea-c6fd52acdcce tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.257518 Apr 05 12:07:32.020462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 86/172] 10.222.0.36 () {60 vars in 1306 bytes} [Mon Apr 5 12:07:31 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:07:32.026423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:32.027366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:32.036661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:32.037775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:32.038834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:32.039526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:32.285194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:07:32.285673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:07:32.286243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:07:32.286871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:07:32.287227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:07:32.296973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:32.297661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:32.298759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:32.299511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:32.320684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Getting quotas for project 4a624cba82a54b939eb86267a2c9023d. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:07:32.325204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Getting quotas for user 5f5ba41bd70340f08f50f229da0b5bc1 and project 4a624cba82a54b939eb86267a2c9023d. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:07:32.338314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:07:32.341340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:07:32.404664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ee51544e-c30a-439c-bc39-66ef525efa42 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644700 Apr 05 12:07:32.405776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 87/173] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:07:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:07:32.416222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-96b11bb6-11c8-47b7-97c1-25fc6d5e10f0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:32.419712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-96b11bb6-11c8-47b7-97c1-25fc6d5e10f0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:32.522300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-96b11bb6-11c8-47b7-97c1-25fc6d5e10f0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:32.538171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-96b11bb6-11c8-47b7-97c1-25fc6d5e10f0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1214 microversion: 2.1 time: 0.126084 Apr 05 12:07:32.552858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 88/174] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:32 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:32.942689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:32.956708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ab795163-0e56-4cc9-a042-88728e3a171a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.935115 Apr 05 12:07:32.957432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 87/175] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:32 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:33.288834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142267432", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "07054388-504e-4ac2-b33c-6ef540158df3"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:33.408662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] validate_networks() for [('07054388-504e-4ac2-b33c-6ef540158df3', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:07:33.557710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:33.559080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:33.568764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:33.569498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:33.570547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:33.571193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:33.822899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:33.831085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2de5c337-5ae8-4d04-ab07-bfa005d70dee tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1266 microversion: 2.1 time: 0.278775 Apr 05 12:07:33.832232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 88/176] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:33 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:33.981670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:33.983195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:33.992985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:33.994483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:33.995545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:33.996390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:34.462814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:07:34.463287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:07:34.463860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:07:34.464505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:07:34.464972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:07:34.474785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:34.475448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:34.476377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:34.476888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:34.496259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:07:34.500407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for user f1dcc49efc6f4a75aaf0573cb97591a7 and project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:07:34.512810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:07:34.515547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:07:34.584951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8886742c-887c-4942-899f-aca544ed1b51 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300021 Apr 05 12:07:34.591723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 89/177] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:07:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:07:34.596967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-11924f33-fe28-4b04-a1f7-efd87e2cbcac tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:34.597640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-11924f33-fe28-4b04-a1f7-efd87e2cbcac tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:34.719714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-11924f33-fe28-4b04-a1f7-efd87e2cbcac tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:34.744953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-11924f33-fe28-4b04-a1f7-efd87e2cbcac tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1218 microversion: 2.1 time: 0.149528 Apr 05 12:07:34.745629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 90/178] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:34 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:34.851243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:34.852064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:34.868102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:34.869244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:34.871029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:34.872283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.039383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:35.040826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:35.054454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3c0def97-74d6-4b73-989a-6d132d788c7b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 1.080536 Apr 05 12:07:35.055259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 89/179] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:33 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:35.059184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0f8031d6-376e-406e-9764-07ab82402da0 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1272 microversion: 2.1 time: 0.212899 Apr 05 12:07:35.070546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 91/180] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:34 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:35.178326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:35.179598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:35.200021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:35.200943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.201992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:35.204631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.211665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-73811f85-3542-4169-a9e9-be093051df64 req-47bb7064-c787-4a5e-9dde-ceabb70e427d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:35.213541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:35.213541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:35.236019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-73811f85-3542-4169-a9e9-be093051df64 req-47bb7064-c787-4a5e-9dde-ceabb70e427d service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:35.236511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-73811f85-3542-4169-a9e9-be093051df64 req-47bb7064-c787-4a5e-9dde-ceabb70e427d service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.290842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-73811f85-3542-4169-a9e9-be093051df64 req-47bb7064-c787-4a5e-9dde-ceabb70e427d service nova] Creating event network-changed:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:07:35.296886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-73811f85-3542-4169-a9e9-be093051df64 req-47bb7064-c787-4a5e-9dde-ceabb70e427d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089774 Apr 05 12:07:35.297573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 92/181] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:35.402417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4290ea2c-7b61-4eed-ac35-6de2599907cd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 0.228371 Apr 05 12:07:35.403712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 90/182] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:35 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:35.767771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:35.768541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:35.776868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:35.777575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.778790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:35.779465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:35.909586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:35.919622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fd02af4f-e06c-4c49-a1bb-e1674486636d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1270 microversion: 2.1 time: 0.156219 Apr 05 12:07:35.920538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:35 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:36.073761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:36.075068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:36.078751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:36.079431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:36.096075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.096870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:36.097875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.098604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:36.103373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.120469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:36.123406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.125855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:36.640691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:36.651116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-edb8c3da-3641-430c-ad25-089fd231f8d5 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1272 microversion: 2.1 time: 0.576566 Apr 05 12:07:36.651757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:36 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1272 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:36.656726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:36.657820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:36.666590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.667094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:36.667933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:36.668416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:37.183056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d8d2f3d-e256-4e9a-8f3b-d351fa5fd5e2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 0.529614 Apr 05 12:07:37.183911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 95/185] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:36 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:37.205085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:37.206089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:37.235029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:37.236291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:37.243259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:37.244034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:37.427338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:37.440689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ed705851-c2ab-4262-8b87-8c1a132363bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1276 microversion: 2.1 time: 0.252418 Apr 05 12:07:37.441331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 96/186] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:37 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:37.523695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:37.549970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4fb9328b-51af-4725-b926-c54901a53ddb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 1.481994 Apr 05 12:07:37.554111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 91/187] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:36 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:37.669093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:37.669767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:37.682259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:37.682771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:37.683630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:37.684122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.205981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:38.214296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:38.225522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.226252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.227284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.227954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.467833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-577c3e34-1673-4916-9df8-4e8481a4470e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 0.276731 Apr 05 12:07:38.469100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 92/188] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:38 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:38.477759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:38.478791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:38.506703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.507442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.508486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.509192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.518988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:38.537260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f17bdce8-cc6d-4991-88da-ba08959eca2e tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.867566 Apr 05 12:07:38.538174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 97/189] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:37 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:38.573441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:38.573794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:38.593062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.593332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:38.609840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:38.610413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.054084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:39.074702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-428bf928-a94c-43db-b6db-566257c52daf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.603425 Apr 05 12:07:39.075697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 93/190] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:38 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:39.135994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:39.151079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ca6d791-42a4-459b-baa0-85f59d7e2a51 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.581815 Apr 05 12:07:39.161285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 98/191] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:38 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:39.446057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:39.446666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:39.455167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.455949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.456830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.457517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.480166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:39.481440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:39.489948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.490703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.491741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.492422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.530316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:07:39.683970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-87f3a4ec-c1c6-408a-b00b-3e2c2751acf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 204 len: 0 microversion: 2.1 time: 0.242447 Apr 05 12:07:39.685267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 94/192] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:07:39 2021] DELETE /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:07:39.695932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:39.696950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:39.707909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.709581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.710995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.711970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.917456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-035b742a-5288-41a6-96d2-3d7ebe34426d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 0.441027 Apr 05 12:07:39.921069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 99/193] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:39 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:39.924955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:39.925601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:39.960477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.962659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:39.963562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:39.964067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.367542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:40.377655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3820de86-f8ea-489a-a562-0e60863ddaeb tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.690723 Apr 05 12:07:40.384581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 95/194] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:39 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:40.403384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:40.404083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:40.425062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.426225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.427787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.429456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.519227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:40.535667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a0f4343-648d-4ae3-b6d2-7e8dec0d7a85 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.615998 Apr 05 12:07:40.538079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 100/195] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:39 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:40.548875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:40.554349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:40.563159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.564174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.565189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.565849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.757590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:40.770364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a642c4e-980e-418c-8619-126f15eec363 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.382549 Apr 05 12:07:40.772291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 96/196] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:40 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:40.784355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-91dec263-2d36-42bc-b3da-91b844709f47 req-90b9c402-ab03-463c-9de1-7320932e2361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f8c771-c22a-4737-ad78-38d7e75ea49f", "tag": "5999d8cb-7f6f-4e9d-9e7c-3cdff0133623"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:40.788746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:40.788746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:40.800311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-91dec263-2d36-42bc-b3da-91b844709f47 req-90b9c402-ab03-463c-9de1-7320932e2361 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.800813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-91dec263-2d36-42bc-b3da-91b844709f47 req-90b9c402-ab03-463c-9de1-7320932e2361 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.819632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-91dec263-2d36-42bc-b3da-91b844709f47 req-90b9c402-ab03-463c-9de1-7320932e2361 service nova] Creating event network-changed:5999d8cb-7f6f-4e9d-9e7c-3cdff0133623 for instance e9f8c771-c22a-4737-ad78-38d7e75ea49f on hv-cinder-78476 Apr 05 12:07:40.825471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-91dec263-2d36-42bc-b3da-91b844709f47 req-90b9c402-ab03-463c-9de1-7320932e2361 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051420 Apr 05 12:07:40.826321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 97/197] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:40.930116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:40.931560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:40.940014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.940695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:40.941661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:40.942315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.198317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:41.207876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0e7aefe8-292e-4ae4-88aa-62633042ae6a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.668495 Apr 05 12:07:41.209245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:40 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:41.214218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-a6dadbdd-a545-404b-9894-e76a02493f53 req-ef8e2932-9db5-49c5-aca4-287b793b8f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ee4b07-0251-47f5-aeb0-67863bdd6672", "tag": "8982c272-f481-4303-82c5-1958c6301c19"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:41.216077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:41.216077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:41.225167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a6dadbdd-a545-404b-9894-e76a02493f53 req-ef8e2932-9db5-49c5-aca4-287b793b8f65 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.225667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a6dadbdd-a545-404b-9894-e76a02493f53 req-ef8e2932-9db5-49c5-aca4-287b793b8f65 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.243205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-a6dadbdd-a545-404b-9894-e76a02493f53 req-ef8e2932-9db5-49c5-aca4-287b793b8f65 service nova] Creating event network-changed:8982c272-f481-4303-82c5-1958c6301c19 for instance 90ee4b07-0251-47f5-aeb0-67863bdd6672 on hv-cinder-78476 Apr 05 12:07:41.248034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-a6dadbdd-a545-404b-9894-e76a02493f53 req-ef8e2932-9db5-49c5-aca4-287b793b8f65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037493 Apr 05 12:07:41.248841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 102/199] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:41.403222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:41.403996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:41.412222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.412735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.413579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.414073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.627838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:41.640337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9a2d816d-c731-427d-9020-d05039462297 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.241447 Apr 05 12:07:41.640962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 103/200] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:41 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:41.645585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:41.646423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:41.654366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.654879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.655717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.656205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.874806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:41.884706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-60f6b7e0-77bc-46c3-96c1-7d82ebe8c737 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.242669 Apr 05 12:07:41.885307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 104/201] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:41 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:41.889906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:41.890588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:41.898228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.898729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:41.899554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:41.900036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:42.156153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:42.170586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7e87dd95-f8f0-41cd-8169-d775cff6f4b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.284130 Apr 05 12:07:42.171215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 105/202] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:41 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:42.227561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:42.228347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:42.237237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:42.237835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:42.238792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:42.239606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:42.456322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:42.465634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3df1f66-a1e8-41f2-b7bd-e65b2afda1c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.243033 Apr 05 12:07:42.466397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 106/203] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:42 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:42.658680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:42.659362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:42.667499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:42.668007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:42.668847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:42.669337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:42.992429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:43.001447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3b4b6816-a325-4500-b21d-6b212b06fae8 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.346914 Apr 05 12:07:43.002078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 107/204] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:42 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:43.007476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:43.008136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:43.015860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.016359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.017210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.017670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.245191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:43.254471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-05876b2a-6b97-4a89-af53-c9b202b8b587 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.251302 Apr 05 12:07:43.255069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 108/205] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:43 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:43.260108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:43.260933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:43.269225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.269822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.271354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.271854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.556058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:43.564694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c4ca0305-490a-455e-aa0e-7c88e4573ac2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.308393 Apr 05 12:07:43.565302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 109/206] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:43 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:43.570581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:43.571240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:43.578679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.579179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.580008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:43.580492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:43.802956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:43.812803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b8b659b4-8fcd-4dc2-97ab-5a21da529203 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.246367 Apr 05 12:07:43.813453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 110/207] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:43 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:44.007336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bcc76fa7-2cd4-4dcd-98fe-960e61d582cf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 3.081918 Apr 05 12:07:44.008020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 98/208] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:40 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 3084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:44.019616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:44.020424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:44.029339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.029920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.030853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.031421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.265560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:44.275013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-113d4d35-4545-43c7-aecb-6a28f9dc92d2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.259522 Apr 05 12:07:44.275191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:44.275887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 111/209] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:44 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:44.276004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:44.284890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.285540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.286924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.287413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.584157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:44.585176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:44.593962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.594827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.595881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.596573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.706100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:44.720894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-91bbe7d1-edad-499f-95e2-efdef9bef1ec tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.450585 Apr 05 12:07:44.732754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 99/210] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:44 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:44.831561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:44.832238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:44.840945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.841460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.842321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:44.843057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:44.906054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:44.925543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9d8f888-fd28-4112-92cb-f948c0d6f4ca tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.346323 Apr 05 12:07:44.926428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 112/211] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:44 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:45.018947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:45.020183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:45.029077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.029622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.030490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.030978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.073319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:45.082157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0760765e-4f98-4df1-8aa8-3e8c28f7f289 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.255037 Apr 05 12:07:45.082879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 100/212] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:44 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:45.293148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:45.293826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:45.302544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.303399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.304224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.304721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.665682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:45.674551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9bc0874e-ae20-468f-90de-912fe389e97c tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.385404 Apr 05 12:07:45.675176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 101/213] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:45 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:45.739548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:45.740383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:45.748114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.748625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.749461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:45.749953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:45.971601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:45.981379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f73d2d50-12e3-4e22-9bce-1f23556f9a90 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.245973 Apr 05 12:07:45.982014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 102/214] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:45 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:45.993700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:45.994400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:46.002048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.002595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.003445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.003943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.216421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:46.226180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-decb676b-40ce-4b9f-874b-d2b2eea9bb6a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.237528 Apr 05 12:07:46.226753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 103/215] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:45 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:46.231342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:46.231995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:46.239672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.240171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.240998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.241478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.458270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:46.468223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-beabe670-6c61-4657-9758-7abe32a56323 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.240434 Apr 05 12:07:46.468830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 104/216] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:46 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:46.692224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:46.693576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:46.701235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.701736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.702591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:46.703078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:46.908348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:46.917097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e1e384db-4fa6-4979-b96d-28f85c1d1b31 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.228874 Apr 05 12:07:46.917712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 105/217] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:46 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:47.000471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:47.001232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:47.009617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.010148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.011006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.011508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.228369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:47.237700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-38ae83a4-6f0d-4903-a74d-8eb5edb3d9f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.241291 Apr 05 12:07:47.238347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 106/218] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:46 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:47.243515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:47.244179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:47.251702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.252206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.253031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.253518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.465359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:47.474160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2e6132b9-8c2c-4567-a875-2466a7929610 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.234717 Apr 05 12:07:47.474795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 107/219] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:47 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:47.484757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:47.485410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:47.493308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.493804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.494650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.495132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.792636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:47.801522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-93bd16c9-6427-4c68-998a-3d37c400eefa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.320410 Apr 05 12:07:47.806817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 108/220] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:47 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:47.934513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:47.935222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:47.943716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.944215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:47.945059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:47.945518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.163753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:48.172638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e4274347-f841-41c6-b6ea-fbfd86b7b5ff tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.242113 Apr 05 12:07:48.173260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 109/221] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:47 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:48.257276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:48.257943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:48.265632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.266112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.266953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.267443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.478705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:48.487940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9caf8d1f-8a9d-4be4-8e43-7c07c56450ed tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.235323 Apr 05 12:07:48.488549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 110/222] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:48 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:48.493635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:48.494335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:48.501477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.501972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.502847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.503331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.708782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:48.717749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3fd0776e-3a5d-4278-8b58-eed3fb60c14c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.228159 Apr 05 12:07:48.718407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 111/223] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:48 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:48.819462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:48.820207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:48.828228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.828781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:48.829567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:48.830111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.041907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:49.050770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-57853066-65b1-4a61-9698-048f34b4a540 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.235257 Apr 05 12:07:49.051397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:48 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:49.190871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:49.191566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:49.200074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.200641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.201468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.201953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.241469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bf1f86e2-89e0-49b4-aa2d-89f314b9c8dc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 4.226234 Apr 05 12:07:49.242208 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 113/225] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:45 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 4228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:49.507551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:49.508340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:49.517647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.518207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.519399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.519692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.563810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:49.574014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8f4cd862-68e9-428a-9e18-23c6b5408007 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.387070 Apr 05 12:07:49.574715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 113/226] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:49 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:49.736343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:49.737021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:49.745306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.745722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.746593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:49.747081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:49.800019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:49.819637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a09542ee-71ab-4145-bfd2-e26d147a7f88 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.316571 Apr 05 12:07:49.821818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 114/227] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:49 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:50.011198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:50.019702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4913ed3e-0b32-4ce1-af07-03d7c0ce7a59 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.287477 Apr 05 12:07:50.020304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 114/228] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:49 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:50.068779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:50.069495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:50.077559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.078072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.078935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.079429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.253335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:50.254971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:50.263430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.264219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.265307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.265905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.298428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:50.308369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fc567d63-d676-42f0-bb80-d2bf63a9d3b5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.243769 Apr 05 12:07:50.309225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 115/229] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:50 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:50.590971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:50.591654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:50.600324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.600832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.601755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.602332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.808301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:50.816932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bc0427a2-fc03-41c8-9fb4-a0aac8f2fa61 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.229916 Apr 05 12:07:50.818036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 116/230] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:50 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:50.837291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:50.837952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:50.845337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.845845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.846696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:50.847189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:50.866641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d9a69a1a-b10d-4d2a-b0e2-ce256ad57a6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 14 microversion: 2.20 time: 0.617158 Apr 05 12:07:50.871169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 115/231] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:50 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 14 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:51.038218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:51.039000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:51.047850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.048363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.049208 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.049703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.059223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:51.069354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-596770b3-af5f-412b-9777-6cf2428922dd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.236255 Apr 05 12:07:51.071765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 117/232] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:50 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:51.323133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:51.327788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:51.328663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:51.335967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c402b0bd-6c30-4292-bcdf-d4d48e826664 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.302653 Apr 05 12:07:51.336863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 116/233] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:51 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:51.338286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.338796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.339646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.340300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.622499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:51.631469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-37858f8b-0bf1-4d63-bd23-563ef929d3f4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.309048 Apr 05 12:07:51.632096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 118/234] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:51 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:51.836135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:51.836787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:51.844617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.845125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.845960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.846473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.879568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:51.881405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:51.889902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.890794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:51.891630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:51.892126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.087871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9a90dbee-16f5-41d3-a35e-4a5c26ffbc1d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 1721 microversion: 2.20 time: 0.212311 Apr 05 12:07:52.088603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 119/235] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:51 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:07:52.094745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:52.097323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:52.101000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:52.106458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.107223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.108227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.108795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.112552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b90857b6-c91e-401d-814c-211f0b839174 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.280971 Apr 05 12:07:52.113462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 117/236] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:51 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:52.351533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:52.353557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:52.354278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:52.363648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.364139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.366520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.366665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ace38bf7-5056-4476-87bd-f2e9f899e072 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1554 microversion: 2.1 time: 0.276631 Apr 05 12:07:52.367179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 120/237] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:52 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:52.376819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.651589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:52.652802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:52.663239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.664420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.666199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:52.666940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:52.901625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:52.911298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f7cf47b-3ef3-428c-b355-fdbde4989ee5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.266092 Apr 05 12:07:52.917679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 121/238] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:52 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:53.052275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:53.062100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2d2aed48-ce8f-49ae-8e75-a0c3ed27a7df tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.712808 Apr 05 12:07:53.062922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 118/239] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:52 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:53.100557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:53.101828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:53.128625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.129136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.130799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.131630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:53.132308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:53.144171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.149449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.149967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.150888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.151400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.371730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d0e2ce2-d6af-4ce1-98ac-b2ef34918b77 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 9954 microversion: 2.20 time: 0.276288 Apr 05 12:07:53.372783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 122/240] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:53 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 9954 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:07:53.385673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:53.386471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:53.394885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.395635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.397008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.397473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.540417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:53.550743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c7d08427-bf43-47e7-a771-d92ae42ed113 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1512 microversion: 2.1 time: 0.169465 Apr 05 12:07:53.551591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 123/241] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:53 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:53.646946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:53.656597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-14ba0cfc-cd46-4bca-9871-9fdae101bccd tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.529451 Apr 05 12:07:53.657209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 119/242] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:53 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:53.806776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-9bc71b23-f358-45a6-81d0-a641f1ef5015 req-73b41eba-5bc0-4359-a97c-35f2da7d464f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8684743b-ae41-4c22-ab30-6d1e41e460be", "name": "network-vif-deleted", "tag": "5886b48b-907c-49d7-8944-4161b3a705cb"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:53.809259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:07:53.809259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:07:53.821151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9bc71b23-f358-45a6-81d0-a641f1ef5015 req-73b41eba-5bc0-4359-a97c-35f2da7d464f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.821151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9bc71b23-f358-45a6-81d0-a641f1ef5015 req-73b41eba-5bc0-4359-a97c-35f2da7d464f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.841812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-9bc71b23-f358-45a6-81d0-a641f1ef5015 req-73b41eba-5bc0-4359-a97c-35f2da7d464f service nova] Creating event network-vif-deleted:5886b48b-907c-49d7-8944-4161b3a705cb for instance 8684743b-ae41-4c22-ab30-6d1e41e460be on hv-cinder-78476 Apr 05 12:07:53.846687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-9bc71b23-f358-45a6-81d0-a641f1ef5015 req-73b41eba-5bc0-4359-a97c-35f2da7d464f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045186 Apr 05 12:07:53.847327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 124/243] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:07:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:07:53.929354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:53.930349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:53.938514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.939029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:53.939912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:53.940402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.081637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:54.081943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:54.096570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.097092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.097950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.098478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.164898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:54.174989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c9d13e7-6f17-4d0f-9eb7-250b678f6db3 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.249659 Apr 05 12:07:54.176181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 120/244] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:53 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:54.318561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:54.327202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a5ed7d8a-c41c-4346-afc3-8fd9c54f6f9c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.250699 Apr 05 12:07:54.327813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 125/245] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:54 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:54.383337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:54.384468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:54.392252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.392753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.393582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.394066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.569769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:54.570487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:54.578860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.579366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.580194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.580672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.702745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:54.713082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ec2fac82-388b-4987-9544-eef2a047c506 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1512 microversion: 2.1 time: 0.148118 Apr 05 12:07:54.713704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 126/246] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:54 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:54.719823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:54.720519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:54.728100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.728600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.729418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:54.729900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:54.942163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:54.951445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-678c24f7-6cc1-4a61-a3f4-70d824220108 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.235236 Apr 05 12:07:54.952038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 127/247] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:54 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:55.194929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:55.195635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:55.203524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.204020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.204844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.205327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.417479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:55.426163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-40d231dd-8bba-45cf-a302-e701e7a72db6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.235967 Apr 05 12:07:55.426784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 128/248] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:55 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:55.431878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:55.432644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:55.439942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.440443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.441263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.441745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.649658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:55.658387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a5bb846c-9486-4855-a4eb-130b117ba2a8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.229995 Apr 05 12:07:55.659100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 129/249] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:55 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:55.731248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:55.731911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:55.740251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.740751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.741577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.742060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.865514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:55.875028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3f781b84-fbf0-4691-b7d5-a93beea934f9 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1512 microversion: 2.1 time: 0.147669 Apr 05 12:07:55.875689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 130/250] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:55 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:55.968770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:55.969384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:55.977229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.977735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:55.978612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:55.979105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:56.203199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:56.212479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c83baabc-cbfc-44e3-9f41-57aa6cc3df0b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.247684 Apr 05 12:07:56.213117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 131/251] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:55 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:56.445414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:56.446102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:56.454911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:56.455554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:56.456399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:56.456918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:56.674151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:56.683713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4dde843-ccb7-44fb-8a68-898ef88784dd tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.242644 Apr 05 12:07:56.684575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 132/252] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:56 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:56.688894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:56.689550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:56.698869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:56.699219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:56.700053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:56.700540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.115505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:57.124439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9c02b759-3d02-4959-808e-0bc24035c940 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.439090 Apr 05 12:07:57.125067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 133/253] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:56 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:57.132648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:57.133358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:57.141190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.141694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.142555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.143045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.264150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:57.274206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4a0a2587-aa35-4afb-bb4d-c142cdf82970 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1346 microversion: 2.1 time: 0.145365 Apr 05 12:07:57.274826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 134/254] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:57 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:57.279354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:57.280019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:57.287447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.287955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.288786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.289276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.496498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:57.506191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6d48c032-8e73-41e6-91c0-3538f50acf76 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.230314 Apr 05 12:07:57.506832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 135/255] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:57 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:57.701630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:57.702369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:57.710238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.710758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.711601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:57.712134 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:57.923070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:57.931925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-15188239-087b-4f7b-a0a4-99eefe6493df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.234296 Apr 05 12:07:57.932552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 136/256] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:57 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:07:57.942783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1b546673-7e48-4195-8888-f12bc8208bb9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 20991 microversion: 2.20 time: 3.563145 Apr 05 12:07:57.943483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 121/257] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:54 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 20991 bytes in 3565 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:07:58.142753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:58.143496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:58.152085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.152593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.153431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.153922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.293423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:58.294258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:58.303640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.304149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.304991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.305483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.377931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:58.388211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6ef8b537-c6e7-4860-8e99-23a97259902b tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.249661 Apr 05 12:07:58.390364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 137/258] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:58 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:58.456734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68543d297a4a4206ba1c8e88d846d798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1f3610ab26944db91319f80a64eb76d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:58.466384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b3e282c2-2463-4e0d-ac2f-08000a721cf8 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 200 len: 1346 microversion: 2.1 time: 0.177605 Apr 05 12:07:58.466997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 122/259] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:58 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 1346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:58.524438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:58.525133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:58.532867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.533521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.534196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.534684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.760351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:58.769479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-165fffe7-99a0-4444-9f02-fcf8565c8136 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.249505 Apr 05 12:07:58.770120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 138/260] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:58 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:58.955412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:07:58.957122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:58.958649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:58.964306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:58.972534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.973050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.973978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.974852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.975784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.975929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:58.978873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:58.979438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.153989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1f8572b5-d8fb-4e53-acc7-aee0b951137a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 22706 microversion: 2.20 time: 0.202567 Apr 05 12:07:59.155790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 139/261] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:07:58 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 22706 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:07:59.311493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:59.322307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d19a9cd9-f84f-4b46-9b60-773218676982 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.377060 Apr 05 12:07:59.322931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 123/262] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:58 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:59.408885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:59.409661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:59.418381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.418888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.419888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.420200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.490883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:59.491577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:59.499945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.500525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.501446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.501853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.562676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] HTTP exception thrown: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. Apr 05 12:07:59.563440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Returning 404 to user: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:07:59.564262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-da17e427-c01d-4acb-b618-383de57331fb tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 404 len: 111 microversion: 2.1 time: 0.081018 Apr 05 12:07:59.564844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 124/263] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:59 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:07:59.658349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:07:59.668298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10c2a81e-16f1-44da-a51c-b5d42e32ee4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.264024 Apr 05 12:07:59.669077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 140/264] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:59 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:07:59.792910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:07:59.793581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:07:59.801253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.801805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:07:59.802662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:07:59.803147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.034500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:00.044986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-034859f4-f19d-4276-a071-660600392852 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.256066 Apr 05 12:08:00.045596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 125/265] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:07:59 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:00.166634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:00.167952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:00.175696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.176194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.177247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.177724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.341470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:00.342324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:00.345004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f61ac445-3017-4c68-b43e-c4f43f79d524 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 23792 microversion: 2.20 time: 0.182323 Apr 05 12:08:00.345809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 141/266] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:00 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 23792 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:00.350810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.351359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.352201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.352686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.578561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:00.587620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-85fcb8c0-bbeb-48c4-8f9a-048b5ef64285 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.251533 Apr 05 12:08:00.588237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 126/267] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:00 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:00.687636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:00.688392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:00.696879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.697406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.698236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:00.698728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:00.918490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:00.928498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2da19e63-5230-4999-a15c-764b15566f32 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.245311 Apr 05 12:08:00.929306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 142/268] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:00 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:01.064358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:01.065721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.073848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.077352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.077352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.077352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.221298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:01.221895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.231026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.231538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.232427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.232926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.291434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] HTTP exception thrown: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. Apr 05 12:08:01.292111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Returning 404 to user: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:01.293021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f06c36a-bdf9-4ef2-9ec0-4f3fc017b1fd tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 404 len: 111 microversion: 2.1 time: 0.075982 Apr 05 12:08:01.294786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 143/269] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:08:01 2021] DELETE /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:08:01.299016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:01.304496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:01.305179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] [instance: 8684743b-ae41-4c22-ab30-6d1e41e460be] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.308541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bc56c520-d580-4bd3-a7ff-de76add0e48d tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.248145 Apr 05 12:08:01.314564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.315080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.316698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.316698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.318608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 127/270] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:01 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:01.359933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:01.361453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.371607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.372408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.374497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.375233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.377966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] HTTP exception thrown: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. Apr 05 12:08:01.378776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] Returning 404 to user: Instance 8684743b-ae41-4c22-ab30-6d1e41e460be could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:01.379681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-97dab22d-87b3-466d-a9b9-523b5f947800 tempest-DeleteServersTestJSON-505386981 tempest-DeleteServersTestJSON-505386981-project] 10.222.0.36 "GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be" status: 404 len: 111 microversion: 2.1 time: 0.080364 Apr 05 12:08:01.381516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 144/271] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:01 2021] GET /compute/v2.1/servers/8684743b-ae41-4c22-ab30-6d1e41e460be => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:08:01.498918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ef252993-b737-4e4c-9c20-00ba6f05d5d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 24666 microversion: 2.20 time: 0.145378 Apr 05 12:08:01.499633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 128/272] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:01 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 24666 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:08:01.605740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:01.606426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.615467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.615977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.616866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.617360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.867339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:01.876836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9cfb5cf6-2360-455d-a639-d6c11d844718 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.275173 Apr 05 12:08:01.877671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 145/273] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:01 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:01.947438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:01.948413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:01.957062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.957560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:01.959013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:01.959694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.195697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:02.204925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5b2243b9-4ead-4843-90e3-74a1c2b52ac0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.262396 Apr 05 12:08:02.205550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 129/274] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:01 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:02.326490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:02.327159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:02.343265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.343973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.345116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.345743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.367174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-fe2d0aa6-d333-447e-87e4-ba0a32105312 req-8aab17c1-311c-47e3-88fe-ef1907e64d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f8c771-c22a-4737-ad78-38d7e75ea49f", "name": "network-vif-plugged", "status": "completed", "tag": "5999d8cb-7f6f-4e9d-9e7c-3cdff0133623"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:02.369022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:02.369022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:02.388210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fe2d0aa6-d333-447e-87e4-ba0a32105312 req-8aab17c1-311c-47e3-88fe-ef1907e64d84 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.388711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fe2d0aa6-d333-447e-87e4-ba0a32105312 req-8aab17c1-311c-47e3-88fe-ef1907e64d84 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.426297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-fe2d0aa6-d333-447e-87e4-ba0a32105312 req-8aab17c1-311c-47e3-88fe-ef1907e64d84 service nova] Creating event network-vif-plugged:5999d8cb-7f6f-4e9d-9e7c-3cdff0133623 for instance e9f8c771-c22a-4737-ad78-38d7e75ea49f on hv-cinder-78476 Apr 05 12:08:02.444149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-fe2d0aa6-d333-447e-87e4-ba0a32105312 req-8aab17c1-311c-47e3-88fe-ef1907e64d84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081014 Apr 05 12:08:02.446844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 130/275] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:02.512751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:02.514417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:02.540526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.541008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.545174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.547733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.744048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aa058a2c-9672-4c13-95c8-89bc2691640f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 25788 microversion: 2.20 time: 0.235144 Apr 05 12:08:02.746058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 131/276] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:02 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 25788 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:08:02.896536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:02.897589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:02.934589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.935273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:02.936264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:02.936630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:03.093570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:03.128464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6b6c3a4d-c1b9-4a1a-bc54-180173699e39 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.801509 Apr 05 12:08:03.129245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 146/277] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:02 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:03.225975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:03.226870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:03.250076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:03.250794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:03.251853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:03.252525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:03.265830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:03.278817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b717529d-40db-4219-9afb-b8f4ee68a810 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.387138 Apr 05 12:08:03.279447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 132/278] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:02 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:03.757249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:03.758543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:03.766602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:03.767113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:03.767951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:03.768555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:03.877157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:03.887080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6c6818c5-6638-45f9-8b83-b11bee2772cb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.665332 Apr 05 12:08:03.887702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 147/279] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:03 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:04.146096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:04.147151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:04.165934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.166801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.167591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.168210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.275726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c05ce7a4-77be-467c-a24e-77ad88273bd2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 27031 microversion: 2.20 time: 0.522362 Apr 05 12:08:04.276760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 133/280] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:03 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 27031 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:08:04.297550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:04.298687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:04.307445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.308242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.309284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.309960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.413841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:04.422651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-37a7b978-6cc1-4928-aaae-e51cf6b93778 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.280795 Apr 05 12:08:04.423290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 148/281] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:04 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:04.495530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-8816d728-1421-4677-9000-c00357463f82 req-f563dc3b-0446-4c01-9b63-79fbd5ddae4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ee4b07-0251-47f5-aeb0-67863bdd6672", "name": "network-vif-plugged", "status": "completed", "tag": "8982c272-f481-4303-82c5-1958c6301c19"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:04.497768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:04.497768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:04.507945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-8816d728-1421-4677-9000-c00357463f82 req-f563dc3b-0446-4c01-9b63-79fbd5ddae4a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.508313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-8816d728-1421-4677-9000-c00357463f82 req-f563dc3b-0446-4c01-9b63-79fbd5ddae4a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.527347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-8816d728-1421-4677-9000-c00357463f82 req-f563dc3b-0446-4c01-9b63-79fbd5ddae4a service nova] Creating event network-vif-plugged:8982c272-f481-4303-82c5-1958c6301c19 for instance 90ee4b07-0251-47f5-aeb0-67863bdd6672 on hv-cinder-78476 Apr 05 12:08:04.532496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-8816d728-1421-4677-9000-c00357463f82 req-f563dc3b-0446-4c01-9b63-79fbd5ddae4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042191 Apr 05 12:08:04.533895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 149/282] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:08:04.573194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:04.584052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ac0be8d4-814f-4efb-91c0-666063d4eeba tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.290927 Apr 05 12:08:04.584776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 134/283] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:04 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:04.905888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:04.907724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:04.917707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.918479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:04.919956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:04.920608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.159673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:05.178197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0e19a1bc-b53b-4c9b-aec8-6a9a98305789 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.276667 Apr 05 12:08:05.182173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 150/284] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:04 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:05.288268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:05.289309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:05.297076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.297590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.298464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.298956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.439763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:05.440700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:05.450614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.451202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.452349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.452926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.702612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:05.713001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cbbc9270-4121-4053-99d0-3c8c64e9a7b2 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.277132 Apr 05 12:08:05.713661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 151/285] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:05 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:05.718953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:05.719870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:05.728257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.728760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:05.729599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:05.730182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:06.101209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:06.127852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c3f51ffd-1ec7-4229-be18-86d308fc3d44 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.412767 Apr 05 12:08:06.138087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 152/286] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:05 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:06.199222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:06.199909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:06.208258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:06.208918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:06.209704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:06.210171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:06.493771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:06.503228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8cb3fdfa-dbd1-4f56-a78a-2f446c203fa8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.310300 Apr 05 12:08:06.504143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 153/287] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:06 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:06.731020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:06.731709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:06.740182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:06.740697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:06.741543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:06.742036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:07.325947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:07.357854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fc8e74b6-726f-4d69-9643-c1c57d56b62f tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.630818 Apr 05 12:08:07.359003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 154/288] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:06 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:07.365888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:07.366736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:07.378258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:07.379091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:07.380663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:07.381614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:07.657842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:07.668167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3358fe58-e90a-4211-b4d3-f2528cfe9650 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.307894 Apr 05 12:08:07.669292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 155/289] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:07 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:07.674234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:07.675072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:07.684442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:07.685104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:07.686333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:07.687128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:07.945477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:07.955849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-79ff6250-d6bf-4a93-9903-6b507f7b138a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.285218 Apr 05 12:08:07.956904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 156/290] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:07 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:08.376163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:08.376978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:08.388323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.389819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:08.391546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.392530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:08.627727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:08.638611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c61f178b-4a50-4fe1-a57d-c4f7fe1e255a tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.266353 Apr 05 12:08:08.639770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 157/291] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:08 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:08.690919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:08.691839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:08.702299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.703045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:08.704964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.705702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:08.949572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:08.961391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ad46cdd6-a126-4818-8417-666738924305 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.274246 Apr 05 12:08:08.962106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 158/292] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:08 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:08.975424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:08.976244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:08.984230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.984848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:08.985808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:08.986457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:09.311067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:09.322223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-725e949c-43a4-4770-92e4-2682b810ec61 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.351349 Apr 05 12:08:09.323092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 159/293] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:08 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:09.658091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:09.658798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:09.668835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:09.669363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:09.670231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:09.670733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:09.920233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:09.941715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4f7caf89-a358-48e6-b0ed-a0ee0b9c7714 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.287344 Apr 05 12:08:09.943370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 160/294] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:09 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:09.981490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:09.982213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:10.001105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.001597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:10.002979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.003637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:10.116461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b6ee40c-b3f7-4bb7-9fa9-951d9d6c102b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 27837 microversion: 2.20 time: 4.832176 Apr 05 12:08:10.122110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 135/295] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:05 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 27837 bytes in 4839 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:10.347769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:10.349767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:10.362166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.363193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:10.364554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.365609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:10.384985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:10.395981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e8219b6e-90be-4284-a47a-7913d05201c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1520 microversion: 2.1 time: 0.420424 Apr 05 12:08:10.401605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 161/296] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:09 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:10.828158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:10.841736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d6d7a3a1-c444-4bcc-b1a0-207ff4f101a7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.505834 Apr 05 12:08:10.845896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 136/297] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:10 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:10.961430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:10.962575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:10.995427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.996008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:10.997264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:10.997910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.130576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:11.132272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:11.156771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.159380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.160562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.164305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.411388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7614b518-9bea-435d-8c8b-72c527f9d8d6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 27837 microversion: 2.20 time: 0.285293 Apr 05 12:08:11.412098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 137/298] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:11 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 27837 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:08:11.421290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:11.422077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:11.464849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.466865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.467945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.472934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.701556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:11.712278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-323b5018-dfcf-49f2-82fc-f90662b0f0be tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1314 microversion: 2.1 time: 0.755869 Apr 05 12:08:11.727011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 162/299] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:10 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:11.863548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:11.864267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:11.883846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.884611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:11.886996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:11.889299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.071985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:12.084263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28ccee97-3f2a-4480-a52e-d90dc2484dbe tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1500 microversion: 2.1 time: 0.667328 Apr 05 12:08:12.084913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 138/300] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:11 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1500 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:12.104962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:12.105639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:12.127352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.128125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.134299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.135286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.702500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:12.715231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-027c4219-361f-468b-97dc-6233b353f112 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1318 microversion: 2.1 time: 0.855228 Apr 05 12:08:12.716244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 163/301] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:11 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:12.721521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:12.723997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:12.736036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.736920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.737997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.738756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.769174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:12.784436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0dbb6ce4-0c88-4398-840f-6527a23045ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1515 microversion: 2.1 time: 0.685739 Apr 05 12:08:12.787418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 139/302] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:12 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1515 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:12.794565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:12.799003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:12.818885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.820009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.821375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:12.823989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:12.880262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-00e65c25-30dd-4a34-9e6b-91caf7b6d38c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28082 microversion: 2.20 time: 0.161804 Apr 05 12:08:12.881681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 164/303] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:12 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28082 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:13.307476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:13.318759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-12c7e5e9-298d-481a-ad94-a8afa0ba2541 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1463 microversion: 2.1 time: 0.529970 Apr 05 12:08:13.319608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 140/304] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:12 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1463 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:13.468377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:13.469045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:13.483661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:13.484179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:13.485055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:13.485556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:13.644607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:08:13.735445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:13.737145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:13.746935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:13.747847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:13.748923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:13.750370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.174991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-851f6bd6-d6ca-42df-be93-8d3cc99b8b09 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 204 len: 0 microversion: 2.1 time: 0.710764 Apr 05 12:08:14.178935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 165/305] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:08:13 2021] DELETE /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:08:14.187924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:14.194026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:14.212055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.212570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.213431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.213921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.353097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3092e8e3-5e50-4f0b-8274-fbe9c13488ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.175979 Apr 05 12:08:14.354644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 166/306] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:14 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:14.360045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:14.360815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:14.379411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.380598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.381460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.381953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.749157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:14.763271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cd06cb6d-0bed-4bc2-bb34-c9622bc080dc tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1469 microversion: 2.1 time: 0.407267 Apr 05 12:08:14.763930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 167/307] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:14 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:14.794658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:14.809582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d4985881-fe04-452c-a433-0a2543c61bea tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1507 microversion: 2.1 time: 1.078802 Apr 05 12:08:14.810532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 141/308] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:13 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1507 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:14.828889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1e1f8c-c3e7-4484-89c6-612f180297f3"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:14.830216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:14.847718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.849144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.850414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.850995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.900842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:14.904699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:14.913901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.917244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.918253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:14.920123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:14.985865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lazy-loading 'flavor' on Instance uuid 7c919762-cc2c-4e9f-854d-785eed7cf1df {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:08:15.087987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Invalid volume: volume eb1e1f8c-c3e7-4484-89c6-612f180297f3 is already attached to instances: 340a418d-96b3-4566-88fe-9f580c3f939d Apr 05 12:08:15.088682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 400 to user: Invalid volume: volume eb1e1f8c-c3e7-4484-89c6-612f180297f3 is already attached to instances: 340a418d-96b3-4566-88fe-9f580c3f939d {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:15.089758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9cd30463-09f9-40f0-acd1-dc7b94038042 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.265349 Apr 05 12:08:15.090621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 168/309] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:08:14 2021] POST /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672/os-volume_attachments => generated 174 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:08:15.216405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7328f20a-5c6e-40b4-92ac-27ac42d7cd20 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action" status: 200 len: 32 microversion: 2.1 time: 0.320829 Apr 05 12:08:15.217066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 142/310] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:08:14 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:08:15.237013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:15.237706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:15.246622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:15.248905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:15.256905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.257419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.258513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.259020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.282313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.283083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.284166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.284849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.585185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'services' on Instance uuid 340a418d-96b3-4566-88fe-9f580c3f939d {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:08:15.653557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:15.665377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d2259b1b-2a75-4381-9156-7821b26b914d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.437953 Apr 05 12:08:15.676730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 169/311] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:15 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:15.676730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:15.676730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:15.686255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.686889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.687863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.688586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.798571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-48861cda-c1a1-4c75-b95f-82ab005534b1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d/os-volume_attachments/eb1e1f8c-c3e7-4484-89c6-612f180297f3" status: 202 len: 0 microversion: 2.1 time: 0.569850 Apr 05 12:08:15.799538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 143/312] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:08:15 2021] DELETE /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d/os-volume_attachments/eb1e1f8c-c3e7-4484-89c6-612f180297f3 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:15.806793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:15.809447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:15.814903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-376f5da7-d09d-4ac3-b739-b8869ed71487 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.146429 Apr 05 12:08:15.815835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 170/313] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:15 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:15.825311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.826068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:15.827098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:15.827736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:16.308897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-354420641", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "824ff9bc-3428-4660-94c8-a66bfd483c75"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:16.470498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] validate_networks() for [('824ff9bc-3428-4660-94c8-a66bfd483c75', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:08:16.736097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:16.749570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-00691f49-dd59-49fd-82b8-ffad084f32c3 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1469 microversion: 2.1 time: 0.948117 Apr 05 12:08:16.750609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 144/314] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:15 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1469 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:16.756040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:16.756979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:16.766291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:16.767115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:16.768323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:16.769025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:17.339270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:17.351906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2f3a157e-591d-441b-a670-95c612afecaa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.599884 Apr 05 12:08:17.352731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 145/315] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:16 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:17.357618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:17.358779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:17.368300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:17.368621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:17.369471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:17.370448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:17.494863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7ffc846c-640b-4679-b4e2-08e91d3fb34e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.140737 Apr 05 12:08:17.498987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 146/316] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:17 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:17.644655 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: .version_select at 0x7f0105afeae8>, body: {"keypair": {"name": "tempest-keypair-1304852366"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:17.668244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:17.672322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:17.904865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:17.909397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:17.924523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-29aa21dd-eef8-43f2-afd7-98d60ace19ed tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.427338 Apr 05 12:08:17.925202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 147/317] 10.222.0.36 () {60 vars in 1148 bytes} [Mon Apr 5 12:08:17 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:17.930415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1684670144", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "07054388-504e-4ac2-b33c-6ef540158df3"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:18.036361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] validate_networks() for [('07054388-504e-4ac2-b33c-6ef540158df3', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:08:18.552502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:08:18.553519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:08:18.554066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:08:18.554555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:08:18.555014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:08:18.574571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:18.575229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:18.576179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:18.576673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:18.602033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Getting quotas for project aeef6c5c7cf04cec883416dc0997d657. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:18.607811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Getting quotas for user 2bcdc8380d7a490393ab556937743e20 and project aeef6c5c7cf04cec883416dc0997d657. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:18.622588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:08:18.626091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:08:18.712237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3ebdb6e1-2df8-4b9f-b3ee-d4e99731e5ea tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408351 Apr 05 12:08:18.730120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 171/318] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:08:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 12:08:18.741088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:18.742424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:18.759324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:18.762713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:18.765465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:18.767800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:18.915299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:18.915804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:18.921822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lazy-loading 'fault' on Instance uuid e9f8c771-c22a-4737-ad78-38d7e75ea49f {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:08:19.059852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f5ba41bd70340f08f50f229da0b5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a624cba82a54b939eb86267a2c9023d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:19.072556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7a8ed834-603b-45ad-9217-8a3cfb5c9e70 tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 200 len: 1304 microversion: 2.1 time: 0.339410 Apr 05 12:08:19.077958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 172/319] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:18 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 1304 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:19.083172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:19.089318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:19.108225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.109607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.116373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.117091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.365751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:08:19.366512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:08:19.367316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:08:19.367944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:08:19.368557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:08:19.382952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.385075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.389948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.390681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.435470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:19.449072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for user f1dcc49efc6f4a75aaf0573cb97591a7 and project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:19.470649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:08:19.477929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:08:19.566096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-911c9a1b-ee09-4ef9-a5ea-fb7a055e8fef tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637231 Apr 05 12:08:19.567413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 148/320] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:08:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:08:19.581157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-da8bd472-d662-4ca0-9181-2d5017858a8e req-57eef343-f2dc-4521-9f5a-23b9f5ac8464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f8c771-c22a-4737-ad78-38d7e75ea49f", "name": "network-vif-deleted", "tag": "5999d8cb-7f6f-4e9d-9e7c-3cdff0133623"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:19.586751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:19.586751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:19.612207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-da8bd472-d662-4ca0-9181-2d5017858a8e req-57eef343-f2dc-4521-9f5a-23b9f5ac8464 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.612689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-da8bd472-d662-4ca0-9181-2d5017858a8e req-57eef343-f2dc-4521-9f5a-23b9f5ac8464 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.639945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-da8bd472-d662-4ca0-9181-2d5017858a8e req-57eef343-f2dc-4521-9f5a-23b9f5ac8464 service nova] Creating event network-vif-deleted:5999d8cb-7f6f-4e9d-9e7c-3cdff0133623 for instance e9f8c771-c22a-4737-ad78-38d7e75ea49f on hv-cinder-78476 Apr 05 12:08:19.648796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-da8bd472-d662-4ca0-9181-2d5017858a8e req-57eef343-f2dc-4521-9f5a-23b9f5ac8464 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076504 Apr 05 12:08:19.649728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 149/321] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:19.657614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:19.661358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:19.682965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:19.697518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.698174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aef38007-3dc3-4f97-b886-417a02695fd9 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.615169 Apr 05 12:08:19.698819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 173/322] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:19 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:19.700964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.703329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.705012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.714025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:19.717501 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:19.735133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.735641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.736492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:19.736986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:19.911656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-07be5360-6563-4c38-b275-ea1423b4da5e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.258144 Apr 05 12:08:19.917925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 150/323] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:19 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:19.928397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1055a134-16d7-4f46-9a67-8d91e8aac6a3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:19.936148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1055a134-16d7-4f46-9a67-8d91e8aac6a3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:19.998985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:20.011963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-87e06b1c-a03d-4b5b-b152-781b9783e241 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1209 microversion: 2.1 time: 0.311304 Apr 05 12:08:20.013282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 174/324] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:19 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1209 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:20.096748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:20.097701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] [instance: e9f8c771-c22a-4737-ad78-38d7e75ea49f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:20.104007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1055a134-16d7-4f46-9a67-8d91e8aac6a3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:20.114898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1055a134-16d7-4f46-9a67-8d91e8aac6a3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1218 microversion: 2.1 time: 0.191921 Apr 05 12:08:20.115526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 151/325] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:19 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:20.145337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.147829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:20.155197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.156135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:20.246865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] HTTP exception thrown: Instance e9f8c771-c22a-4737-ad78-38d7e75ea49f could not be found. Apr 05 12:08:20.247536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] Returning 404 to user: Instance e9f8c771-c22a-4737-ad78-38d7e75ea49f could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:20.248443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a9d7a99e-46f6-483d-9d79-561c15f4215b tempest-VolumesNegativeTest-122691302 tempest-VolumesNegativeTest-122691302-project] 10.222.0.36 "GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f" status: 404 len: 111 microversion: 2.1 time: 0.156439 Apr 05 12:08:20.249466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 175/326] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:20 2021] GET /compute/v2.1/servers/e9f8c771-c22a-4737-ad78-38d7e75ea49f => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:08:20.719209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:20.720032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:20.737607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.738147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:20.739548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.740008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:20.925236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:20.929698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:20.950159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.950656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:20.951502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:20.951987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:21.158208 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-38ec5456-d28a-42d5-9a2e-661adc27e12d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.236703 Apr 05 12:08:21.169844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 176/327] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:20 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:21.185097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:21.187078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:21.210908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:21.212145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:21.214982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:21.216595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:21.270241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:21.283577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6fd29a15-b79f-4e47-a11d-6f7ea6206f9c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.569506 Apr 05 12:08:21.284228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 152/328] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:20 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:21.309307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:21.310036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:21.330730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:21.334855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:21.336062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:21.336757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:21.588854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:21.603648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-553aa42c-395b-451a-b5a7-f810ace1afc8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1270 microversion: 2.1 time: 0.305586 Apr 05 12:08:21.614280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 153/329] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:21 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:21.845607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:21.856866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b435c1a1-29d4-4157-abab-1df7cc87a437 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1271 microversion: 2.1 time: 0.684670 Apr 05 12:08:21.872055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 177/330] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:21 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1271 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:22.173113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:22.174301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:22.201410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.202013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:22.202958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.203656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:22.301947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:22.302770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:22.318286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.318807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:22.321551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.322060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:22.333324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-90f6ca77-62ff-42c4-a1d5-f1dde7123c2f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.163489 Apr 05 12:08:22.334055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 154/331] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:22 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:22.622617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:22.623391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:22.644137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.646488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:22.648013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:22.650584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:23.047828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:23.068176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5854f449-be90-4c84-aab8-4bfd0f2636e7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1276 microversion: 2.1 time: 0.449567 Apr 05 12:08:23.069040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 155/332] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:22 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1276 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:23.085866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:23.087228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:23.104141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:23.104861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:23.106064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:23.107037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:23.315958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:23.347638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-492dbdb2-bddb-4d04-a24c-a5a73c6431db tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1271 microversion: 2.1 time: 0.277225 Apr 05 12:08:23.351169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 156/333] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:23 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:23.363527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:23.366829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:23.401031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:23.406329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:23.407465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:23.423881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:23.455621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:23.468746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0afbb157-0485-4f1e-99d4-a9a0eaa6b012 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 1.171243 Apr 05 12:08:23.469111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 178/334] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:22 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:23.625872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-72d37516-228f-43bc-bc1d-1512e1641c3e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.273210 Apr 05 12:08:23.627743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 157/335] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:23 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:24.087086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:24.087943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:24.117236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:24.117737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:24.121861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:24.122406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:24.367391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:24.368505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:24.384450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:24.392306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:24.393445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:24.402509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:25.058456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:25.076718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce210c4c-afbf-4abd-9188-aa9001c80290 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.993259 Apr 05 12:08:25.077791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 179/336] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:24 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:25.083376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:25.084332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:25.093241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:25.094308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:25.095743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:25.096695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:25.275150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:25.289729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0ad20bea-998b-4c57-92bd-0be88dc15a7f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.923463 Apr 05 12:08:25.291772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 158/337] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:24 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:25.305913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:25.310009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:25.325818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:25.326480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:25.327713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:25.330509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:25.531525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7316328f-f61f-4125-8bb8-1a687142248f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.236812 Apr 05 12:08:25.533041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 159/338] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:25 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:25.539965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1448912015", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1a45c1-5bda-4177-9f6d-4ce95f1005fb"}], "security_groups": [{"name": "tempest-securitygroup--174428452"}], "key_name": "tempest-keypair-1304852366", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:25.643476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:25.654922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a835699d-9bcc-4544-8052-bfa155783025 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.575824 Apr 05 12:08:25.658013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 180/339] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:25 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:25.904613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] validate_networks() for [('0d1a45c1-5bda-4177-9f6d-4ce95f1005fb', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:08:26.096889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:26.098686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:26.140575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:26.141354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:26.142842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:26.145287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:26.692811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:26.704719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-654d9174-33fc-4653-8164-f0c2cef3a241 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.612190 Apr 05 12:08:26.705343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 181/340] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:26 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:26.711667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:26.712529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:26.733333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:26.734472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:26.738456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:26.739688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.339535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:27.353473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1309d440-bc2b-48e8-b756-1c6cb1730317 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.647020 Apr 05 12:08:27.354402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 182/341] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:26 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:27.376032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:27.377603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:27.392636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.399438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.400586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.401287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.570224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-36c90970-16b7-4f43-903a-211a4bf03aea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.213729 Apr 05 12:08:27.572238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 183/342] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:27 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:27.578915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:27.580631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:27.591758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.592460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.593762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.594420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.926703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:08:27.927014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:08:27.927637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:08:27.928320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:08:27.928865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:08:27.938638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.939518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.940807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:27.941554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:27.966407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:27.971977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:27.988256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:08:27.993533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:08:28.087837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9faea8f0-65a8-4d5c-a8e7-1b6077bbd4ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.553281 Apr 05 12:08:28.088797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 160/343] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:08:25 2021] POST /compute/v2.1/servers => generated 401 bytes in 2555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:08:28.102461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-29fc190e-f525-40ff-ac88-acd72c734578 req-bfaf0c7a-8930-42e8-83a2-b544c12fee6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3920e06e-a129-4ec6-9663-83d002e65b75", "tag": "8ca70e09-43be-428e-8720-f600ff4f15c3"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:28.104725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:28.104725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:28.120165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-29fc190e-f525-40ff-ac88-acd72c734578 req-bfaf0c7a-8930-42e8-83a2-b544c12fee6b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.120867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-29fc190e-f525-40ff-ac88-acd72c734578 req-bfaf0c7a-8930-42e8-83a2-b544c12fee6b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.143405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-29fc190e-f525-40ff-ac88-acd72c734578 req-bfaf0c7a-8930-42e8-83a2-b544c12fee6b service nova] Creating event network-changed:8ca70e09-43be-428e-8720-f600ff4f15c3 for instance 3920e06e-a129-4ec6-9663-83d002e65b75 on hv-cinder-78476 Apr 05 12:08:28.151368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-29fc190e-f525-40ff-ac88-acd72c734578 req-bfaf0c7a-8930-42e8-83a2-b544c12fee6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060732 Apr 05 12:08:28.152195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 161/344] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:28.158564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:28.159510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:28.168883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.169569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.170958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.171611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.645556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:28.680012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-df04c1e6-e0bf-444e-a56a-8420edf231bb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 1.099380 Apr 05 12:08:28.683332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 184/345] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:27 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:28.704273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-3dc53dc0-aa1e-439e-8741-b73133f80695 req-d9b48817-756b-4742-9245-4e9b2b02a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b76dc471-47cc-4b87-a3f0-8309af9aa790", "tag": "c0b82022-589f-4b45-a8d6-945f8492e0e0"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:28.707461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:28.707461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:28.720630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-3dc53dc0-aa1e-439e-8741-b73133f80695 req-d9b48817-756b-4742-9245-4e9b2b02a2e8 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.721233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-3dc53dc0-aa1e-439e-8741-b73133f80695 req-d9b48817-756b-4742-9245-4e9b2b02a2e8 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.741144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-3dc53dc0-aa1e-439e-8741-b73133f80695 req-d9b48817-756b-4742-9245-4e9b2b02a2e8 service nova] Creating event network-changed:c0b82022-589f-4b45-a8d6-945f8492e0e0 for instance b76dc471-47cc-4b87-a3f0-8309af9aa790 on hv-cinder-78476 Apr 05 12:08:28.746772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-3dc53dc0-aa1e-439e-8741-b73133f80695 req-d9b48817-756b-4742-9245-4e9b2b02a2e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055965 Apr 05 12:08:28.747570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 185/346] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:28.753484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:28.755546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:28.763601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.764195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.765336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.766057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.957121 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:28.970097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b03f265e-e099-425a-abb4-3312dcd1e375 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1242 microversion: 2.1 time: 0.221151 Apr 05 12:08:28.970709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 186/347] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:28 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:28.976232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:28.977433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:28.986763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.987742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:28.989535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:28.990340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:29.112808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:29.127364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b26938b5-eaaa-4d5f-b15f-21f3ec7cae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.971265 Apr 05 12:08:29.128041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 162/348] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:28 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:29.138782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:29.138782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:29.148555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:29.149083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:29.155068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:29.155778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:29.337865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7fa2f094-5027-4b27-b531-699c3264f233 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28199 microversion: 2.20 time: 0.208405 Apr 05 12:08:29.342341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 163/349] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:29 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28199 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:29.652547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:29.675362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a7d98a62-35e2-4d8b-bed1-d598559d83eb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.703366 Apr 05 12:08:29.678515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 187/350] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:28 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:29.702103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:29.702935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:29.721521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:29.722021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:29.726601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:29.727314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:29.989252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:29.990350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:30.007018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.007620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.008749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.009460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.372987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:30.383534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a94fd94-f139-4243-a79c-d70887e142b6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1296 microversion: 2.1 time: 0.398426 Apr 05 12:08:30.393896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 188/351] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:29 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:30.393896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:30.393896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:30.399243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.399750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.400657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.401057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.667017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:30.682383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc99e765-6c04-4e53-9707-0b77e8903caa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.983609 Apr 05 12:08:30.683499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 164/352] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:29 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:30.702817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:30.704514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:30.714167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.714726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.715585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.716141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.783877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:30.793714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-842bd931-05a0-490d-a9b4-75ae3d05cf38 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.408204 Apr 05 12:08:30.804385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 189/353] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:30 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:30.804385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:30.804385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:30.812452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.812948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:30.813837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:30.814364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:31.050472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:31.060592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6dcb523c-1621-4ad7-af1a-53b16301ce4d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.261436 Apr 05 12:08:31.061379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 190/354] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:30 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:31.402249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:31.402899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:31.411437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:31.411944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:31.412790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:31.413274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:31.560136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:31.569701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3166c754-ee18-4f1a-a0e2-43540a910680 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1296 microversion: 2.1 time: 0.171858 Apr 05 12:08:31.570378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 191/355] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:31 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:31.700952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:31.701625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:31.709621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:31.710156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:31.711005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:31.711492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:31.963215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:31.973757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9b5c374c-e2a5-4bb7-83f9-d7c89e954c3a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.276937 Apr 05 12:08:31.974686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 192/356] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:31 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:31.991095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:31.992075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:32.002545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.003040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:32.004132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.005428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:32.393203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:32.403325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b797166-c56d-4c36-a4e2-091eb50628b6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.417442 Apr 05 12:08:32.403970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 193/357] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:31 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:32.408606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:32.409272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:32.418116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.419282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:32.420296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.420841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:32.861664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:32.872996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a73c972-fab2-4088-bb0c-c15370725221 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.467841 Apr 05 12:08:32.884070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 194/358] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:32 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:32.885073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:32.885848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:32.898800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.899600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:32.900665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:32.901580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:33.069782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:33.078967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-853348a1-8db1-4a63-8999-80d5e07a3e66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1296 microversion: 2.1 time: 0.204160 Apr 05 12:08:33.080384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 195/359] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:32 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:33.085483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:33.086425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:33.095502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:33.096291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:33.097268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:33.098387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:33.889259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:33.899460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fa5061fc-6c98-430f-96d2-c663a23745da tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.817649 Apr 05 12:08:33.900190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 196/360] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:33 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:33.905769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:33.906593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:33.917485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:33.918166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:33.919310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:33.920248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:34.427532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:34.439663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a8e37dda-099d-4982-b9cc-ad5424dd62e9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.538223 Apr 05 12:08:34.442656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 197/361] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:33 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:34.449300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:34.450187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:34.460987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:34.461701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:34.463858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:34.465170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:34.813178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:34.822773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dedac418-e01f-4f62-9146-c9ab5517aa7b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.378587 Apr 05 12:08:34.823600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 198/362] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:34 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:34.830063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:34.830752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:34.839571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:34.840166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:34.841146 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:34.841699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.040674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:35.049566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a8dfe365-25c2-4b42-97fe-92b9c7047dc9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1296 microversion: 2.1 time: 0.223218 Apr 05 12:08:35.050327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 199/363] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:34 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1296 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:35.055203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:35.056128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:35.063935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.064475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.065329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.065870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.643072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:35.652508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e9e93fe0-96c1-483d-b324-77a226080c55 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.600979 Apr 05 12:08:35.653152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 200/364] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:35 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:35.657765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:35.658454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:35.666540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.667063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.667909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.668395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.731633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6e230d32-ed80-4512-a8b5-1bd0f034a601 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28490 microversion: 2.20 time: 5.046406 Apr 05 12:08:35.733080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 165/365] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:30 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28490 bytes in 5048 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:35.841814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:35.842865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:35.852091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.852839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:35.853849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:35.854560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:36.485674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:36.498824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9b9fe6aa-6457-4b6e-ad26-4f44b1160d01 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.844525 Apr 05 12:08:36.499487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 201/366] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:35 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:36.507024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:36.507700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:36.534712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:36.535293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:36.536406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:36.536903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:36.621505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:36.632269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0d41afc4-11c5-47d8-8f88-2c2998cb51cf tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.794785 Apr 05 12:08:36.636407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 166/367] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:35 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:36.671232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:36.671910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:36.693496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:36.698942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:36.699886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:36.700377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.094683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:37.111102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d0459cb7-1b8d-4824-a994-09d12aec235f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.609845 Apr 05 12:08:37.111733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 202/368] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:36 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:37.117523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:37.124094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:37.138657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.139510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.140534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.141171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.388607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a736e6a-219c-49f3-92ee-9a36cdb50f92 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 28820 microversion: 2.20 time: 0.275315 Apr 05 12:08:37.402653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 203/369] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:37 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 28820 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:37.459180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:37.479005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2903cdd0-0bee-4b84-90ff-c75c7a089462 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.806945 Apr 05 12:08:37.480157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 167/370] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:36 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:37.517804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:37.518628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:37.537193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.537706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.538589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.543139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.654549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:37.656678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:37.669627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.674580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:37.675696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:37.678890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.466939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:38.478050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-83031adc-2f5e-4ec0-80f0-7dc0863db389 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.828222 Apr 05 12:08:38.481351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 168/371] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:37 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:38.489247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:38.489931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:38.513849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.516639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.518287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.521990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.604614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:38.619565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ca7028dc-3e41-451f-82f2-bc62c74fb634 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 1.106299 Apr 05 12:08:38.620217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 204/372] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:37 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:38.639745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:38.654610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:38.669566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.670083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.670983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.675041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.883143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-690342e1-7f43-4048-8cbc-947375911335 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.261521 Apr 05 12:08:38.883870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 205/373] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:38 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:38.896028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:38.896816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:38.916435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.919739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:38.920634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:38.924794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:39.390494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:39.407300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6d8f06fe-88d7-4abc-b139-16e45bd57fc5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.924495 Apr 05 12:08:39.408501 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 169/374] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:38 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:39.496455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:39.497904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:39.511741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:39.516191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:39.517326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:39.518019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:39.739367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:39.748827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8a6463f3-b7c1-4b72-997d-3b2e8680bc69 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1501 microversion: 2.1 time: 0.859795 Apr 05 12:08:39.749693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 206/375] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:38 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1501 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:39.754982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:39.755838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:39.763928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:39.764627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:39.765625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:39.766296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.045157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:40.056664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-caed82f6-6fd3-4096-8a18-9391f0939090 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.564507 Apr 05 12:08:40.057560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 170/376] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:39 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:40.064020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff22c159-0c51-422f-979e-e5fc3a0d5b57"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:40.065550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:40.075743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.076503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.077536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.078206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.201366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] HTTP exception thrown: Cannot 'attach_volume' instance 7c919762-cc2c-4e9f-854d-785eed7cf1df while it is in vm_state rescued Apr 05 12:08:40.202317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Returning 409 to user: Cannot 'attach_volume' instance 7c919762-cc2c-4e9f-854d-785eed7cf1df while it is in vm_state rescued {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:40.203626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f657309-e1ed-4eff-96f2-a3658f90d42d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.143957 Apr 05 12:08:40.208482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 171/377] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:08:40 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 12:08:40.225682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:40.227708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:40.241179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.241585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.242469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.243278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.443364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bea25582-04ca-456f-b569-84c9b734e287 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.237406 Apr 05 12:08:40.444776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 172/378] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:40 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:40.450266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-5fa24bb5-520e-47bf-87c6-ff63891174a3 req-ee7b4a2a-0e65-4e97-b8e7-4d6278e9a16b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65c1062-5d66-496a-ae26-06d7d61b2fed", "tag": "d2955123-ae33-4531-94cd-a14eaa61a2ca"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:40.451624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:40.451624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:40.480941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5fa24bb5-520e-47bf-87c6-ff63891174a3 req-ee7b4a2a-0e65-4e97-b8e7-4d6278e9a16b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.481441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5fa24bb5-520e-47bf-87c6-ff63891174a3 req-ee7b4a2a-0e65-4e97-b8e7-4d6278e9a16b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.519823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-5fa24bb5-520e-47bf-87c6-ff63891174a3 req-ee7b4a2a-0e65-4e97-b8e7-4d6278e9a16b service nova] Creating event network-changed:d2955123-ae33-4531-94cd-a14eaa61a2ca for instance a65c1062-5d66-496a-ae26-06d7d61b2fed on hv-cinder-78476 Apr 05 12:08:40.534955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-5fa24bb5-520e-47bf-87c6-ff63891174a3 req-ee7b4a2a-0e65-4e97-b8e7-4d6278e9a16b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089171 Apr 05 12:08:40.536425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 173/379] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:40.544762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:40.545386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:40.563328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.563840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.564689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.565178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.699834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:40.712417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6329505d-8d84-4648-9b25-8739f1d40078 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.961228 Apr 05 12:08:40.714058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 207/380] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:39 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:40.723382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:40.739535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:40.764324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.765299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.766463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.768447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.840621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bf97b6e6-f065-4386-837b-be38b4224113 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action" status: 202 len: 0 microversion: 2.1 time: 0.299719 Apr 05 12:08:40.842467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 174/381] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:08:40 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:40.854757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-a395ed4a-8a71-4a75-8589-bfa4a4c6b7ec req-ee246f0a-cfb6-451e-aa54-b933f6994200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3920e06e-a129-4ec6-9663-83d002e65b75", "name": "network-vif-plugged", "status": "completed", "tag": "8ca70e09-43be-428e-8720-f600ff4f15c3"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:40.857145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:40.857145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:40.871653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a395ed4a-8a71-4a75-8589-bfa4a4c6b7ec req-ee246f0a-cfb6-451e-aa54-b933f6994200 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.872214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a395ed4a-8a71-4a75-8589-bfa4a4c6b7ec req-ee246f0a-cfb6-451e-aa54-b933f6994200 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.900353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-a395ed4a-8a71-4a75-8589-bfa4a4c6b7ec req-ee246f0a-cfb6-451e-aa54-b933f6994200 service nova] Creating event network-vif-plugged:8ca70e09-43be-428e-8720-f600ff4f15c3 for instance 3920e06e-a129-4ec6-9663-83d002e65b75 on hv-cinder-78476 Apr 05 12:08:40.906828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-a395ed4a-8a71-4a75-8589-bfa4a4c6b7ec req-ee246f0a-cfb6-451e-aa54-b933f6994200 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058984 Apr 05 12:08:40.907734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 175/382] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:40.918407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:40.918914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:40.936334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.937310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:40.939303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:40.941494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.571243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:41.581013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3a91d9d8-70ec-42c3-9051-b1fd5682648a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.865450 Apr 05 12:08:41.581892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 208/383] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:40 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:41.597463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:41.598575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:41.607074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.607799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.608850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.609332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.650408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:41.658544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0bb87940-af22-4ce0-8f58-5c138e930de6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1509 microversion: 2.1 time: 0.746179 Apr 05 12:08:41.659196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 176/384] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:40 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1509 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:41.676718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:41.677285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:41.692318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.692867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.693820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.694368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.811752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-36f8aa72-7bd2-48a2-8be4-201ddd44fa11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.139674 Apr 05 12:08:41.812585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 177/385] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:41 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:41.824731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:41.825524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:41.838311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.839017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:41.840130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:41.840813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:42.274886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:42.302163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ce1e8c8-638e-4e29-acb6-643ddf93a901 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1313 microversion: 2.1 time: 0.707994 Apr 05 12:08:42.303349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 209/386] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:41 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:42.600195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:42.601105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:42.619614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:42.620170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:42.621262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:42.621768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:42.916841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:42.930150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c7d4fb50-4b3f-43bf-92a8-d7dc049e0e15 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 1.110681 Apr 05 12:08:42.942556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 178/387] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:41 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:42.948432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:42.949401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:42.970712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:42.971206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:42.972354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:42.973162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.526790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:43.541928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-488867de-6726-4e34-87be-a728aebe9e53 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.946411 Apr 05 12:08:43.547828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 210/388] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:42 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:08:43.579051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:43.580453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:43.604632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.607782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.609037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.609821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.637000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:43.654480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a05eda8b-d226-47c0-a3dd-cd5e3bb70e8a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1509 microversion: 2.1 time: 0.704583 Apr 05 12:08:43.655172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 179/389] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:42 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1509 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:43.666432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-70a1ea74-632e-49e2-8496-41279bffadaf req-2d634212-95f0-4fa0-bc6c-57a2e8161983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76dc471-47cc-4b87-a3f0-8309af9aa790", "name": "network-vif-plugged", "status": "completed", "tag": "c0b82022-589f-4b45-a8d6-945f8492e0e0"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:43.667480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:43.667480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:43.687486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-70a1ea74-632e-49e2-8496-41279bffadaf req-2d634212-95f0-4fa0-bc6c-57a2e8161983 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.687999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-70a1ea74-632e-49e2-8496-41279bffadaf req-2d634212-95f0-4fa0-bc6c-57a2e8161983 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.724785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-70a1ea74-632e-49e2-8496-41279bffadaf req-2d634212-95f0-4fa0-bc6c-57a2e8161983 service nova] Creating event network-vif-plugged:c0b82022-589f-4b45-a8d6-945f8492e0e0 for instance b76dc471-47cc-4b87-a3f0-8309af9aa790 on hv-cinder-78476 Apr 05 12:08:43.747491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-70a1ea74-632e-49e2-8496-41279bffadaf req-2d634212-95f0-4fa0-bc6c-57a2e8161983 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090513 Apr 05 12:08:43.747885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 180/390] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:43.756203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:43.756560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:43.765799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.766354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.767236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.767735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.814547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-be9ee6dd-a2fe-4da9-a139-78a90c04cb41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.264336 Apr 05 12:08:43.815322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 211/391] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:43 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:43.955483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:43.956151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:43.975897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.977832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:43.979924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:43.983671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.208762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:44.229931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1765802d-9225-4286-8bf3-43f8403dccb0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1497 microversion: 2.1 time: 0.478485 Apr 05 12:08:44.231535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 181/392] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:43 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1497 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:44.483210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:44.493542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4bb457f3-d4c3-4084-9647-f696d02d9dfd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.543930 Apr 05 12:08:44.496603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 212/393] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:43 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:44.565639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:44.566404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:44.575504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.576023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.577008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.577511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.673555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:44.674348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:44.700314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.700833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.701701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.702269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.918028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:44.936722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3018d413-bddc-4e6b-bb11-1a44e50fed60 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.375333 Apr 05 12:08:44.937371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 182/394] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:44 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:44.951691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:44.952876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:44.966561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.970113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:44.973031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:44.974688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.162350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10ad803a-0823-46b0-bb95-2101f308bce2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.223273 Apr 05 12:08:45.163413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 183/395] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:44 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:45.188620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:45.201591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9fbc83e3-0b37-4a92-824f-a4d58ff54a8c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1509 microversion: 2.1 time: 0.532235 Apr 05 12:08:45.206641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 213/396] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:44 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1509 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:45.400606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:45.401577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:45.413946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.414821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.415866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.416561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.514807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:45.515696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:45.526767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:08:45.552243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.552879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.553809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.554368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.857327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d39e85d9-908b-4985-8d79-456e5ead10a7 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 204 len: 0 microversion: 2.1 time: 0.462536 Apr 05 12:08:45.865703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 184/397] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:08:45 2021] DELETE /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:08:45.871925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:45.872763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:45.897749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.898654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:45.899524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:45.900018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.252280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:46.261274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2080d03d-d176-457d-ad60-7df2a51d4ae4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1318 microversion: 2.1 time: 0.752213 Apr 05 12:08:46.261884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 214/398] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:45 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:46.276776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:46.282710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:46.297925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.298948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.301498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.303093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.309304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:46.321307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fadf08bf-0cdc-494d-bbdc-fb228f20f4b4 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1503 microversion: 2.1 time: 0.454031 Apr 05 12:08:46.330439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 185/399] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:45 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:46.342834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:46.349761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:46.382430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.383331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.386560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.387489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.613835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f4e6e6ff-b496-44a2-a950-92f4f4d85e9d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.280798 Apr 05 12:08:46.614964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 186/400] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:46 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:46.620871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:46.622292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:46.642221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.664386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.665824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:46.666551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:46.775656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:46.789028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-16d6535e-545a-44bf-bfbb-229c216f2fcf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.520866 Apr 05 12:08:46.791738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 215/401] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:46 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:47.279775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:47.281076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:47.289418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.290280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.291283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.291924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.555624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:47.565466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-92b1b6e7-a8c3-42d0-a971-83578e40eef8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1507 microversion: 2.1 time: 0.289605 Apr 05 12:08:47.566961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 216/402] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:47 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:47.572143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:47.572979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:47.581302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.582700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.584820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.585522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.843188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:47.858026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c09b8964-21ae-4c38-a02a-86fb003e39be tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1515 microversion: 2.1 time: 1.241457 Apr 05 12:08:47.862753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 187/403] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:46 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1515 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:47.880207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:47.881667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:47.903984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:47.914192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.914917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.917122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc2ec3cb-e4a9-41e5-9527-160a5d40e871 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1503 microversion: 2.1 time: 0.348777 Apr 05 12:08:47.917895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.918529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.940797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 217/404] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:47 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:47.945677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:47.950404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:47.985658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.986166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:47.987316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:47.989328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:48.087813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9b09613-4304-4d3b-886a-daa88625a65b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.222510 Apr 05 12:08:48.092369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 188/405] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:47 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:48.538687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:48.553421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c96dabdf-0646-4bfe-b8fa-63ff1809a81d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.617485 Apr 05 12:08:48.554058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 218/406] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:47 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:48.950606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:48.951404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:48.970343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:48.970855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:48.971841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:48.972437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:49.112178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:49.116954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:49.143752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:49.144440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:49.145280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:49.148720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:49.263657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cad75404-f741-401a-a39c-eed1ca00a749 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.166696 Apr 05 12:08:49.265319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 219/407] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:49 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:49.482232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc6d056a-80f7-4cfc-92a7-f59247947a38"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:49.486250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:49.498439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:49.499232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:49.500272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:49.500912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.036814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:50.048769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-afbd973f-0cee-4a51-822c-e2cb50df37d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1503 microversion: 2.1 time: 1.103427 Apr 05 12:08:50.071963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 189/408] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:48 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1503 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:50.100799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-003437d6-0b71-430b-975a-2df0bd1d4418 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.625523 Apr 05 12:08:50.102363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:50.123376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:50.124844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 220/409] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:08:49 2021] POST /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:50.141816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:50.155558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.157864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.158420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:50.159413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.161527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.195902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.196436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.205281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.205876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.777268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:50.792498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b1c3c87-315f-4509-bf44-832c85f61ad6 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1515 microversion: 2.1 time: 0.653600 Apr 05 12:08:50.796672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 221/410] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:50 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1515 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:50.823532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:50.825140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:50.845513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.849731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:50.849731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:50.857578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:51.068370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ab940c34-4f3e-4fb4-98c3-b67742ef741a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.270123 Apr 05 12:08:51.073048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 222/411] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:50 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:51.075115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-9ca9b5bb-40f5-4241-804c-9a9cb642843c req-df001615-5232-4ccd-adae-92c1523e7558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65c1062-5d66-496a-ae26-06d7d61b2fed", "name": "network-vif-plugged", "status": "completed", "tag": "d2955123-ae33-4531-94cd-a14eaa61a2ca"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:51.084478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:51.084478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:51.098916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9ca9b5bb-40f5-4241-804c-9a9cb642843c req-df001615-5232-4ccd-adae-92c1523e7558 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:51.100213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9ca9b5bb-40f5-4241-804c-9a9cb642843c req-df001615-5232-4ccd-adae-92c1523e7558 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:51.151798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-9ca9b5bb-40f5-4241-804c-9a9cb642843c req-df001615-5232-4ccd-adae-92c1523e7558 service nova] Creating event network-vif-plugged:d2955123-ae33-4531-94cd-a14eaa61a2ca for instance a65c1062-5d66-496a-ae26-06d7d61b2fed on hv-cinder-78476 Apr 05 12:08:51.158460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-9ca9b5bb-40f5-4241-804c-9a9cb642843c req-df001615-5232-4ccd-adae-92c1523e7558 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087790 Apr 05 12:08:51.160128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 223/412] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:51.167848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86c0d4ce-7685-4515-aa61-c9890b787760"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:51.170086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:51.182923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:51.183966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:51.196590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:51.199099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:51.711902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:51.746969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3c17a92-4485-44a5-908e-1d5445262192 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 1.669581 Apr 05 12:08:51.749898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 190/413] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:50 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:51.755510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:51.756184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:51.787885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:51.788404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:51.789276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:51.789818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:52.076228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-18bb3747-3941-484c-b7e7-4ec1985e0392 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896118 Apr 05 12:08:52.079566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 224/414] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:08:51 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:52.092753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-d1a262b5-a94f-4b19-a103-d0319e686f37 req-fbe48b8e-fbe8-479e-ae1d-b00b1aea891c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3920e06e-a129-4ec6-9663-83d002e65b75", "name": "network-vif-deleted", "tag": "8ca70e09-43be-428e-8720-f600ff4f15c3"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:52.094911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:08:52.094911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:08:52.149093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d1a262b5-a94f-4b19-a103-d0319e686f37 req-fbe48b8e-fbe8-479e-ae1d-b00b1aea891c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:52.149880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d1a262b5-a94f-4b19-a103-d0319e686f37 req-fbe48b8e-fbe8-479e-ae1d-b00b1aea891c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:52.171737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-d1a262b5-a94f-4b19-a103-d0319e686f37 req-fbe48b8e-fbe8-479e-ae1d-b00b1aea891c service nova] Creating event network-vif-deleted:8ca70e09-43be-428e-8720-f600ff4f15c3 for instance 3920e06e-a129-4ec6-9663-83d002e65b75 on hv-cinder-78476 Apr 05 12:08:52.178232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-d1a262b5-a94f-4b19-a103-d0319e686f37 req-fbe48b8e-fbe8-479e-ae1d-b00b1aea891c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096485 Apr 05 12:08:52.179460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 225/415] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:08:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:52.185801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:52.187144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:52.199178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:52.199903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:52.201081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:52.201868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:52.271938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:52.289598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-40cef942-010c-4dd2-83f2-88b0f3fcc3d0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 200 len: 1298 microversion: 2.1 time: 0.537796 Apr 05 12:08:52.290670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 191/416] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:51 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 1298 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:52.323861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9c4fed59-f6e5-411f-b2d6-b61c10c1854b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.142262 Apr 05 12:08:52.324827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 226/417] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:52 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:52.765753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:52.766476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:52.787240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:52.787799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:52.788738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:52.789303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:53.310813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:53.311596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 3920e06e-a129-4ec6-9663-83d002e65b75] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:53.322536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:53.323048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:53.329736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:53.330292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:53.404473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] HTTP exception thrown: Instance 3920e06e-a129-4ec6-9663-83d002e65b75 could not be found. Apr 05 12:08:53.405425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Returning 404 to user: Instance 3920e06e-a129-4ec6-9663-83d002e65b75 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:53.406660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-93cc0ab4-76e1-4622-b45a-8f4f68d46a2b tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75" status: 404 len: 111 microversion: 2.1 time: 0.101303 Apr 05 12:08:53.407474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 227/418] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:53 2021] GET /compute/v2.1/servers/3920e06e-a129-4ec6-9663-83d002e65b75 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:08:53.412957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:53.414188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:53.438847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:53.441335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:53.445155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:53.445844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:53.666845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:53.671573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a224068-b60d-453d-b58c-c19bed41728b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.253468 Apr 05 12:08:53.672976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 228/419] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:53 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:53.679897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1669303700", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "824ff9bc-3428-4660-94c8-a66bfd483c75"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:53.689022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-351ea16f-2bd1-4949-9b88-d9cc81a61592 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1363 microversion: 2.1 time: 0.927872 Apr 05 12:08:53.693525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 192/420] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:52 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1363 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:53.811562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] validate_networks() for [('824ff9bc-3428-4660-94c8-a66bfd483c75', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:08:54.685239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:54.687782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:54.708441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:54.710541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:54.711594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:54.712094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:54.945285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c466c691-bfd5-4409-b6fa-4973a84b8be7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.259968 Apr 05 12:08:54.946407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 193/421] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:54 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:08:54.953059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:54.954782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:54.969402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:54.970581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:54.972455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:54.974496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:55.565189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:08:55.573188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:08:55.573963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:08:55.574569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:08:55.575105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:08:55.595642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:55.596408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:55.598006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:55.602171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:55.650553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Getting quotas for project aeef6c5c7cf04cec883416dc0997d657. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:08:55.655626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Getting quotas for user 2bcdc8380d7a490393ab556937743e20 and project aeef6c5c7cf04cec883416dc0997d657. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:08:55.665694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:55.679517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:08:55.681309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cb999903-7362-4421-aeba-3bd310188602 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1550 microversion: 2.1 time: 0.733212 Apr 05 12:08:55.689026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 194/422] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:54 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1550 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:55.689663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:08:55.700373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:55.700919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:55.731219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:55.731707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:55.740939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:55.741686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:55.839283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e9f1d6b3-c46b-4905-8fdf-c1e22eea1519 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164738 Apr 05 12:08:55.845167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 229/423] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:08:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:08:55.857405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f636cb7c-2510-405a-aa5c-5ddd9e745e37 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:55.858072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f636cb7c-2510-405a-aa5c-5ddd9e745e37 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:56.098176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f636cb7c-2510-405a-aa5c-5ddd9e745e37 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:56.127331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f636cb7c-2510-405a-aa5c-5ddd9e745e37 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1214 microversion: 2.1 time: 0.280606 Apr 05 12:08:56.139840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 230/424] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:55 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:56.162836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:56.169244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:56.186290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:56.187182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:56.189980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:56.193834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:56.474980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c1aef65b-53c3-4d3d-b70b-6e8d9b7e084f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.333383 Apr 05 12:08:56.475843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 231/425] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:56 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:56.524854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7bc0d615-d71a-479b-882b-9fef778da980 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.828950 Apr 05 12:08:56.525986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 195/426] 10.222.0.36 () {58 vars in 1265 bytes} [Mon Apr 5 12:08:55 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-interface => generated 285 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:08:57.156017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:57.156822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:57.181774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:57.182350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:57.183812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:57.184312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:57.492629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:57.493678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:57.497071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:57.512572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:57.513330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:57.515211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-29c03950-543c-4eea-a114-cdf736e04eba tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1210 microversion: 2.1 time: 0.365191 Apr 05 12:08:57.515891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:57.516741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:57.530554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 232/427] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:57 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1210 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:57.737279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-41b39789-01d1-4408-89dc-66699191bec7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.249161 Apr 05 12:08:57.739302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 196/428] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:57 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:58.296217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc6d056a-80f7-4cfc-92a7-f59247947a38"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:58.298412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:58.324364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:58.324872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:58.325726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:58.326237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:58.542053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:58.543062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:58.571391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:58.574647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:58.575703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:58.578058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:58.964320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Invalid volume: volume cc6d056a-80f7-4cfc-92a7-f59247947a38 is already attached to instances: b76dc471-47cc-4b87-a3f0-8309af9aa790 Apr 05 12:08:58.966209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 400 to user: Invalid volume: volume cc6d056a-80f7-4cfc-92a7-f59247947a38 is already attached to instances: b76dc471-47cc-4b87-a3f0-8309af9aa790 {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:08:58.967302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5a7443fd-0f4a-4652-838d-f4e5c632ccde tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.676326 Apr 05 12:08:58.968082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 233/429] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:08:58 2021] POST /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments => generated 174 bytes in 678 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 05 12:08:58.982475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:08:58.986479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:59.009457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:59.011614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:59.012691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:59.013230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:08:59.013526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:59.028511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d611f8e8-0314-4f95-b57e-ca62be8c1ccc tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1272 microversion: 2.1 time: 0.494950 Apr 05 12:08:59.037868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 197/430] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:08:58 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1272 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:08:59.251283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:08:59.251837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:08:59.268788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:59.269419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:59.270352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:08:59.270849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:08:59.561138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-749d86f3-ef08-4879-81aa-345454b77dfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.585840 Apr 05 12:08:59.562329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 234/431] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:08:58 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:08:59.851985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'services' on Instance uuid b76dc471-47cc-4b87-a3f0-8309af9aa790 {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:09:00.050199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:00.051804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:00.069913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:00.070533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:00.072996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:00.073727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:00.200835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9793257-02c6-4513-9bc4-aede1fcb7f70 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments/cc6d056a-80f7-4cfc-92a7-f59247947a38" status: 202 len: 0 microversion: 2.1 time: 0.953818 Apr 05 12:09:00.202065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 198/432] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:08:59 2021] DELETE /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790/os-volume_attachments/cc6d056a-80f7-4cfc-92a7-f59247947a38 => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:00.456122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:00.470746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e6211ed0-dbc1-4980-8628-3c3c830a0c49 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1272 microversion: 2.1 time: 0.425311 Apr 05 12:09:00.471770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 235/433] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:00 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1272 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:00.575108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:00.576845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:00.593447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:00.593997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:00.601265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:00.601773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:00.855030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e7e59900-af5b-483f-9824-1289d58b7145 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.284912 Apr 05 12:09:00.855745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 199/434] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:00 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:01.489254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:01.489936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:01.502398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:01.502903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:01.504502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:01.505159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:01.722436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:01.744104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ddbfe8b4-b238-4d78-800f-6273e428a2e8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1272 microversion: 2.1 time: 0.258045 Apr 05 12:09:01.745212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 236/435] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:01 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:01.868020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:01.869512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:01.887532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:01.888591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:01.890170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:01.891026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:02.021095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8cd1dba6-4c90-4777-9202-6d0dc65c420d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.156906 Apr 05 12:09:02.026311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 200/436] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:01 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:02.763174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:02.764575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:02.779928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:02.780610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:02.781634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:02.782337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.036389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:03.037783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:03.051422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:03.055372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.063206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:03.064006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.317238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6ae9a6da-83e2-46a2-bc63-f4224b57abd1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.287098 Apr 05 12:09:03.318385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 201/437] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:03 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:03.328106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:03.339119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:03.351833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:03.352723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.353804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:03.354564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.504650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-89912d6c-e4f8-4b74-8301-a7ba11e10a94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 14 microversion: 2.1 time: 0.184016 Apr 05 12:09:03.505621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 202/438] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:03 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:09:03.516578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-f62c726a-e23a-4a6a-bb72-785002af87b4 req-98b66e11-219a-4021-87ca-e7589b154b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65c1062-5d66-496a-ae26-06d7d61b2fed", "tag": "d2955123-ae33-4531-94cd-a14eaa61a2ca"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:03.517578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:03.517578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:03.535930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f62c726a-e23a-4a6a-bb72-785002af87b4 req-98b66e11-219a-4021-87ca-e7589b154b0e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:03.536537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f62c726a-e23a-4a6a-bb72-785002af87b4 req-98b66e11-219a-4021-87ca-e7589b154b0e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:03.557262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-f62c726a-e23a-4a6a-bb72-785002af87b4 req-98b66e11-219a-4021-87ca-e7589b154b0e service nova] Creating event network-changed:d2955123-ae33-4531-94cd-a14eaa61a2ca for instance a65c1062-5d66-496a-ae26-06d7d61b2fed on hv-cinder-78476 Apr 05 12:09:03.563982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-f62c726a-e23a-4a6a-bb72-785002af87b4 req-98b66e11-219a-4021-87ca-e7589b154b0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057001 Apr 05 12:09:03.565188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 203/439] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:04.034463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:04.044712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-faf1ed50-3576-4671-b1be-a1062b151431 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.286140 Apr 05 12:09:04.053297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 237/440] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:02 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:04.332462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:04.334023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:04.355702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:04.359486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:04.360567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:04.370955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:04.516411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-580c33fa-6586-4c2c-a9c0-9af67366e914 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.189706 Apr 05 12:09:04.516664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:04.517096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 204/441] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:04 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:04.522582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:04.550981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:04.551645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:04.553080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:04.553582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:04.795546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7221ef18-dee9-499b-b5b7-f50be8d28d97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 14 microversion: 2.1 time: 0.282707 Apr 05 12:09:04.796608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 238/442] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:04 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:09:05.072231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:05.073088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:05.095285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.095796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.096674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.097774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.530553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:05.532661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:05.558656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.559164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.560015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.560507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.728257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8f985ed3-80b9-4623-9477-4fc37a3aadfd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.202654 Apr 05 12:09:05.729843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 239/443] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:05 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:05.808329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:05.809797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:05.820726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.821516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.822515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:05.823236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:05.959010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-27e1c82d-1672-422a-b46c-e6737fd74f32 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 14 microversion: 2.1 time: 0.154726 Apr 05 12:09:05.962156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 240/444] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:05 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:09:06.082311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:06.083494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:06.092516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:06.093030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:06.093888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:06.094452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:06.166387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lazy-loading 'flavor' on Instance uuid 7c919762-cc2c-4e9f-854d-785eed7cf1df {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:09:06.530092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-90ec59de-3937-49ba-af6d-1d41c16b9227 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action" status: 200 len: 32 microversion: 2.1 time: 0.453356 Apr 05 12:09:06.530814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 241/445] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:06 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action => generated 32 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:09:06.550299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:06.552038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:06.565017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:06.566479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:06.573039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:06.573706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:07.197592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:07.209391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1503cd5c-165f-417b-8ec3-cf840b3243fb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 2.141120 Apr 05 12:09:07.210695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 205/446] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:05 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:07.216083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:07.217307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:07.225731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:07.226478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:07.227501 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:07.228810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:07.336670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b71eb4e9-123e-4a90-9fb0-725a943e2d1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.123857 Apr 05 12:09:07.337583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 206/447] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:07 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:07.349515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1372116536", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "07054388-504e-4ac2-b33c-6ef540158df3"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:07.478529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] validate_networks() for [('07054388-504e-4ac2-b33c-6ef540158df3', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:09:07.647437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:07.662001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-64118f67-a000-4922-8d8c-0a0025be0365 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 1.124674 Apr 05 12:09:07.671703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 242/448] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:06 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:07.695174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:07.715353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:07.724799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:07.725314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:07.726218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:07.726686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:07.901568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-42ea0116-7104-4add-8778-c4446bc4a291 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 14 microversion: 2.1 time: 0.217586 Apr 05 12:09:07.902843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 243/449] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:07 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:09:08.229686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:08.231065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:08.268485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:08.275979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:08.277915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:08.278664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:08.989632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:09.001839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-01612df6-e16d-488e-8363-7db74ee7c026 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 0.777275 Apr 05 12:09:09.011054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 244/450] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:08 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:09.016379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-aba826bc-18e1-44b8-82f9-addaed7131ec req-4632cfa4-6d19-4d91-8527-f2e285b4b9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc", "tag": "755bd6e5-b716-4a58-a1e2-161e9d54f422"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:09.022407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:09.022407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:09.059589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-aba826bc-18e1-44b8-82f9-addaed7131ec req-4632cfa4-6d19-4d91-8527-f2e285b4b9ba service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:09.060495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-aba826bc-18e1-44b8-82f9-addaed7131ec req-4632cfa4-6d19-4d91-8527-f2e285b4b9ba service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:09.107611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-aba826bc-18e1-44b8-82f9-addaed7131ec req-4632cfa4-6d19-4d91-8527-f2e285b4b9ba service nova] Creating event network-changed:755bd6e5-b716-4a58-a1e2-161e9d54f422 for instance 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc on hv-cinder-78476 Apr 05 12:09:09.121060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-aba826bc-18e1-44b8-82f9-addaed7131ec req-4632cfa4-6d19-4d91-8527-f2e285b4b9ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108333 Apr 05 12:09:09.123629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 245/451] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:09.134536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:09.137296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:09.157035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:09.160740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:09.162026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:09.166353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:09.359729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-508ddc44-c794-4230-803a-3b365c9bae29 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.233114 Apr 05 12:09:09.361050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 246/452] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:09 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:09.368387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:09.369591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:09.381063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:09.381998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:09.383193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:09.383898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.610608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:09:10.611136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:09:10.611560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:09:10.612185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:09:10.612878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:09:10.630010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.630499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.637674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.639769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.688995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:10.703629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Getting quotas for user f1dcc49efc6f4a75aaf0573cb97591a7 and project 6c0184ae62e6427db9fd25988a10a9c2. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:10.726210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:10.737431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:09:10.741295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:09:10.744721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-42264437-1b98-4424-86f7-d0f00e26489c tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 1.381775 Apr 05 12:09:10.747974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 247/453] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:09 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:10.774619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:10.776570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:10.805274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.805791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.806688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.807459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.865818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-df38fa0e-f60d-4e08-a962-9a3e5ea7bdb3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.526882 Apr 05 12:09:10.871067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 207/454] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:09:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 3533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:09:10.883875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:10.884825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:10.905918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.906712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:10.907746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:10.908386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:11.121486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5836a703-2a4b-4305-bf77-104fee3d520b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 18208 microversion: 2.1 time: 0.370333 Apr 05 12:09:11.123514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 248/455] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:10 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 18208 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:11.132286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:11.134833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:11.164088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:11.164605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:11.165642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:11.166157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:11.416368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2e1a4de5-b416-47cf-8a73-9c53dff5ff85 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.290394 Apr 05 12:09:11.420396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 249/456] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:11 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:11.424046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-13bfbcd1-68f8-4eb8-afdd-40e6dcc1643a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:11.426756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-13bfbcd1-68f8-4eb8-afdd-40e6dcc1643a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:12.084660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:12.097926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1acb087f-020b-46dd-bb61-1575c5a54534 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.224904 Apr 05 12:09:12.104793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 208/457] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:10 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:12.110047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:12.110996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:12.140398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.140935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:12.141998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.142841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:12.338469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13bfbcd1-68f8-4eb8-afdd-40e6dcc1643a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:12.349732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-13bfbcd1-68f8-4eb8-afdd-40e6dcc1643a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1218 microversion: 2.1 time: 0.930722 Apr 05 12:09:12.353286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 250/458] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:11 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1218 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:12.373966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:12.379705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:12.408234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.414893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:12.416073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.416728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:12.681882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-340b77e9-8db5-4990-b096-249bb7a8c026 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 19342 microversion: 2.1 time: 0.322393 Apr 05 12:09:12.683133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 251/459] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:12 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 19342 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:12.692652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:12.694513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:12.721227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.726625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:12.730550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:12.734034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.078345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-216f91ef-abb6-45ab-baaa-2ec5cd15b49f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.378069 Apr 05 12:09:13.083098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 252/460] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:12 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:13.126543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:13.127334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:13.158574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.159150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.160389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.161165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.221676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:13.234673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f527bc2-a1ab-4a5a-8b45-e88ba885afef tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 1.128694 Apr 05 12:09:13.250346 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 209/461] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:12 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:13.370665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:13.371719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:13.394545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.395587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.396718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.397425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.657534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:13.667749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8910f44-7963-4ea4-a32e-3fdd9a1cbfd6 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1288 microversion: 2.1 time: 0.300925 Apr 05 12:09:13.678735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 210/462] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:13 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1288 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:13.697318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:13.698933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:13.721851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.722415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.723273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:13.723762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:13.944223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c4b55a71-946f-46be-b625-f29f19aad543 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 21784 microversion: 2.1 time: 0.247863 Apr 05 12:09:13.946199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 211/463] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:13 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 21784 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:14.096011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:14.098611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:14.117970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:14.125994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:14.130473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:14.133523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:14.481886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c65c4771-786c-4e91-b110-852450a777ea tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.391960 Apr 05 12:09:14.482962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 212/464] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:14 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:14.491714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:14.495550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:14.524267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:14.524797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:14.525676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:14.532296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:14.992319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:15.005695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-456d7126-984c-4f09-8d4c-c2762648b2b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 0.521270 Apr 05 12:09:15.007117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 213/465] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:14 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:15.013128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:15.014094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:15.032658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.033681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.036383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.037228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.247860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:15.263145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-95da916d-2b21-4491-8df6-554521c0a92d tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1276 microversion: 2.1 time: 0.253994 Apr 05 12:09:15.266047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 214/466] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:15 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:15.272400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:15.274315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:15.283281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.283742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.286227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.292789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.413466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9166de31-5298-4cad-a8ea-fee80adc686d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 23797 microversion: 2.1 time: 0.145776 Apr 05 12:09:15.414213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 215/467] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:15 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 23797 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:15.500121 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:15.502037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:15.559009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.559581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.575995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:15.576843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:15.784168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:15.811196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-87619baa-5c8a-48c1-9f98-77587c0637cb tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 2.691242 Apr 05 12:09:15.819952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 253/468] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:13 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:15.899229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f09486fd-5d94-4ede-83f0-bf778a009ef9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 29157 microversion: 2.20 time: 0.403682 Apr 05 12:09:15.900980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 216/469] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:15 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 29157 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:16.027315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:16.027989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:16.046528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.047043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.047906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.048396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.287088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:16.287877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:16.317358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.321685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.322770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.326495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.653969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:16.665362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-956e690b-ea0b-4534-9fde-a3c62ca25b47 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 0.642387 Apr 05 12:09:16.671605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 254/470] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:16 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:16.681400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:16.683668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:16.700283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.709870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.711154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.711998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.918811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-124577e5-3d76-4056-bc61-efad66454b0b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 25088 microversion: 2.1 time: 0.244352 Apr 05 12:09:16.920982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 255/471] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:16 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 25088 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:16.930036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:16.931322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:16.943412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.943922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:16.944787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:16.945279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:17.030986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:17.050437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23c76d19-e8cc-49b7-b5d3-4778b98b3084 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.769383 Apr 05 12:09:17.064558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 217/472] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:16 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:17.079226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:17.083286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:17.117060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:17.117578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:17.118502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:17.118999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:17.257742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce43a4fb-df9f-4b03-bdf6-e8195a737f2e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 30176 microversion: 2.20 time: 0.188405 Apr 05 12:09:17.258875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 218/473] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:17 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 30176 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:17.690379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:17.691853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:17.711051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:17.711791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:17.712785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:17.713398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:18.571328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:18.587303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db26b108-f6c4-42c0-bfe0-8c6dd151901f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.664002 Apr 05 12:09:18.588706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 256/474] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:16 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:18.594492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:18.602376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:18.615245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:18.621768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:18.622875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:18.623517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:18.936389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e8a8d5a7-aa96-4fbc-b93c-bacf1d4e54ee tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 27049 microversion: 2.1 time: 0.345845 Apr 05 12:09:18.937700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 257/475] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:18 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 27049 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:18.944098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:18.951320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:18.982217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:18.983471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:18.987592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:18.988332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:19.367577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:19.384164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4e89298a-00dd-4249-90f0-0dfd2221d8f2 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 1.698766 Apr 05 12:09:19.386797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 219/476] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:17 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:19.405442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:19.412480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:19.440959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:19.447434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:19.452584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:19.453624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:19.679980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3a94b682-d6cb-4eec-bdb6-511b8c63eb55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 33412 microversion: 2.20 time: 0.291497 Apr 05 12:09:19.681187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 220/477] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:19 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 33412 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:19.688598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:19.689383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:19.709818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:19.710371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:19.711234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:19.711717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:20.938798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:20.960906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-821c940a-5947-456e-9ceb-014efde91b79 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.278205 Apr 05 12:09:20.977953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 221/478] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:19 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:20.989426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:20.995896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:20.997218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:21.021338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.022169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f50cae5f-ca2f-4ba9-8d4b-2f4c987fb0da tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 2.079401 Apr 05 12:09:21.024984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.026155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.030485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 258/479] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:18 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:21.031493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.039560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:21.040239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:21.077413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.078098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.085688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.086278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.275745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8bf6ee7e-b692-420d-8266-3b47119bec37 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 27808 microversion: 2.1 time: 0.296017 Apr 05 12:09:21.276732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 222/480] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:20 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 27808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:21.283034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:21.291599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:21.337695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.338222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.339066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.339556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.529287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d0e5e887-5de4-47fe-b82f-2c1985e7f4f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 34911 microversion: 2.20 time: 0.250829 Apr 05 12:09:21.530651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 223/481] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:21 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 34911 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:21.539430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-97b605a3-f3bd-4efb-9a0c-0287d71fe832 req-d691983a-f6b0-4c16-8e7e-abdfbc9e3ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eed7b27-b499-4cef-b1c1-2f387e3e690a", "tag": "bf171599-2595-48ef-91f6-d69e602260cb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:21.544356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:21.544356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:21.564920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-97b605a3-f3bd-4efb-9a0c-0287d71fe832 req-d691983a-f6b0-4c16-8e7e-abdfbc9e3ec0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.571199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-97b605a3-f3bd-4efb-9a0c-0287d71fe832 req-d691983a-f6b0-4c16-8e7e-abdfbc9e3ec0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.609491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-97b605a3-f3bd-4efb-9a0c-0287d71fe832 req-d691983a-f6b0-4c16-8e7e-abdfbc9e3ec0 service nova] Creating event network-changed:bf171599-2595-48ef-91f6-d69e602260cb for instance 2eed7b27-b499-4cef-b1c1-2f387e3e690a on hv-cinder-78476 Apr 05 12:09:21.623298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-97b605a3-f3bd-4efb-9a0c-0287d71fe832 req-d691983a-f6b0-4c16-8e7e-abdfbc9e3ec0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090691 Apr 05 12:09:21.624543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 224/482] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:21.926270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-99d26d4a-5e73-4a9d-8da1-bad6853b6287 req-b5df56f0-8ee4-4e0f-b681-1e5c54a52721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc", "name": "network-vif-plugged", "status": "completed", "tag": "755bd6e5-b716-4a58-a1e2-161e9d54f422"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:21.928273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:21.928273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:21.932422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:21.947768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-96619056-f64b-44b6-b7a6-1c977f477525 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 0.915808 Apr 05 12:09:21.966491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-99d26d4a-5e73-4a9d-8da1-bad6853b6287 req-b5df56f0-8ee4-4e0f-b681-1e5c54a52721 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:21.967699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-99d26d4a-5e73-4a9d-8da1-bad6853b6287 req-b5df56f0-8ee4-4e0f-b681-1e5c54a52721 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:21.971423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 259/483] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:21 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:21.979337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:21.985312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:22.013126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:22.015638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:22.020949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:22.022032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:22.034668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-99d26d4a-5e73-4a9d-8da1-bad6853b6287 req-b5df56f0-8ee4-4e0f-b681-1e5c54a52721 service nova] Creating event network-vif-plugged:755bd6e5-b716-4a58-a1e2-161e9d54f422 for instance 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc on hv-cinder-78476 Apr 05 12:09:22.057598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-99d26d4a-5e73-4a9d-8da1-bad6853b6287 req-b5df56f0-8ee4-4e0f-b681-1e5c54a52721 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127644 Apr 05 12:09:22.058519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 225/484] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:22.080647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:22.087772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:22.132888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:22.133404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:22.134312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:22.134757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.030673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:23.047216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e5bdcf76-0092-44d7-b693-cb952e22164c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.987458 Apr 05 12:09:23.048219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 226/485] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:22 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:23.059069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:23.060257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:23.079789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.080298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.081228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.081722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.099965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:23.122594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3fa951d4-94eb-48d6-b578-15f14dbb7789 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.146656 Apr 05 12:09:23.122909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 260/486] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:21 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:23.150166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:23.156941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:23.182323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.182773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.183642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.184127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.492767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-405092fb-4f3c-4997-b704-a91943b8e436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 37121 microversion: 2.20 time: 0.357698 Apr 05 12:09:23.493481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 261/487] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:23 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 37121 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:23.502967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:23.503764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:23.510949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b459f09f-93d0-42ea-b26f-0478b59f1323 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28052 microversion: 2.1 time: 0.461197 Apr 05 12:09:23.511671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 227/488] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:23 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28052 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:23.534521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.535333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:23.536898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:23.539038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:24.066914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:24.068052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:24.097232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:24.098048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:24.098999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:24.099497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:24.548657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:24.562107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-09541722-b85b-48ce-9794-0c65bdead0c4 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1567 microversion: 2.1 time: 1.063370 Apr 05 12:09:24.563731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 262/489] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:23 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1567 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:24.576262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:24.587223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:24.604810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:24.605673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:24.606847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:24.610552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:24.950863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:24.985906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cb169ded-ac67-41c4-a089-70f376f86b4f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.924340 Apr 05 12:09:25.008473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 228/490] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:24 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:25.021702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:25.022793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:25.052907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.054415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:25.055496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.056151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:25.362249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-635d9663-9d36-4319-9ce5-8aff8c0f5d53 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 38709 microversion: 2.20 time: 0.350675 Apr 05 12:09:25.363602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 229/491] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:25 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 38709 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:25.381647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:25.382856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:25.422018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.422621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:25.423409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.423903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:25.703788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4ef44649-871e-43d6-a7f1-8506a579aecb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.338221 Apr 05 12:09:25.705056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 230/492] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:25 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:25.717310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:25.727950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:25.761657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.763218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:25.764856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:25.768142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.184005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:26.203822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c8533495-d998-493a-afcd-e26b72d6f6fa tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1314 microversion: 2.1 time: 1.633307 Apr 05 12:09:26.204510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 263/493] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:24 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1314 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:26.216516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:26.216516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:26.233359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.233868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.234757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.235246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.466906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:26.478288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fdde17ed-7c7e-4393-b1c1-3c890b8622ae tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1547 microversion: 2.1 time: 0.771617 Apr 05 12:09:26.494213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 231/494] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:25 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1547 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:26.499961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:26.500964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:26.521739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.522285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.523149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.523903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.729132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-16310f9b-943b-4cb2-bfd4-19ad47d939a0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 38709 microversion: 2.20 time: 0.243969 Apr 05 12:09:26.733051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 232/495] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:26 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 38709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:26.736771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:26.737947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:26.758797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.759675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:26.760132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:26.767373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.017711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:27.035670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b040d7c9-5869-4cd3-8708-16c6806e26b7 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.824919 Apr 05 12:09:27.036647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 264/496] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:26 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:27.042233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:27.043854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:27.053288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.054026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.055116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.055823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.075258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] HTTP exception thrown: Cannot 'detach_volume' instance 7c919762-cc2c-4e9f-854d-785eed7cf1df while it is in vm_state rescued Apr 05 12:09:27.077704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Returning 409 to user: Cannot 'detach_volume' instance 7c919762-cc2c-4e9f-854d-785eed7cf1df while it is in vm_state rescued {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:09:27.080325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-555efd12-5131-4139-8ad9-fa751deb4940 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments/86c0d4ce-7685-4515-aa61-c9890b787760" status: 409 len: 152 microversion: 2.1 time: 0.346716 Apr 05 12:09:27.084927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 233/497] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:09:26 2021] DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments/86c0d4ce-7685-4515-aa61-c9890b787760 => generated 152 bytes in 354 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 05 12:09:27.092409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:27.092992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:27.141927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.149039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.151001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.151503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.191754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-41b92963-5c30-4990-b418-f0ee10ec642a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.153471 Apr 05 12:09:27.195984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 265/498] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:27 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:27.224734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:27.225510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:27.244072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.244572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.245424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.245912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.504227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-706a7145-e137-4c8c-8c75-3ee39449de2a tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action" status: 202 len: 0 microversion: 2.1 time: 0.417664 Apr 05 12:09:27.504944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 234/499] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:27 2021] POST /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:27.515658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:27.516432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:27.535838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.536344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.537207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.537766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.885831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:27.897165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9572b864-134a-4b53-bc3d-70457f8b1503 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1555 microversion: 2.1 time: 0.385799 Apr 05 12:09:27.908586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 235/500] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:27 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1555 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:27.917752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:27.919268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:27.927785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.928664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:27.929604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:27.930187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.072014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-977e0ff3-04e5-4c1d-8278-415a17667e91 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 38709 microversion: 2.20 time: 0.161235 Apr 05 12:09:28.073458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 236/501] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:27 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 38709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:28.083788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:28.087259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:28.157438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.157762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.158695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.159316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.645345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:28.662966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-31365639-b295-4bde-9b06-c3e9d83c5dcb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.587442 Apr 05 12:09:28.664398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 237/502] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:28 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:28.669782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:28.678304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:28.691360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.698104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.699378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.700080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.837778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eeb9b448-44e6-466f-a1ae-661ad6289e6c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.171692 Apr 05 12:09:28.842060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 238/503] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:28 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:28.886853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:28.899635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7570c780-18a8-47f4-b8e0-e58a1ee8d3b8 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1498 microversion: 2.1 time: 1.680679 Apr 05 12:09:28.902481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 266/504] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:27 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1498 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:28.916739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:28.917504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:28.938621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.939086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:28.939938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:28.940991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.086080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:29.087175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:29.105378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.105859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.115645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.119537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.410992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b75ecf96-9d8e-425b-844a-99e05a01dd2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 200 len: 38852 microversion: 2.20 time: 0.329966 Apr 05 12:09:29.413848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 267/505] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:29 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 38852 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:29.422405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:29.429837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:29.441255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:29.443832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc51e7f6-77b0-4103-a121-04090df6a949 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1555 microversion: 2.1 time: 0.529906 Apr 05 12:09:29.458044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 239/506] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:28 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1555 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:29.463817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.464095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.464945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.465436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.628611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db8cce8e-1094-4fcb-95df-ba15e6cef8f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/ips" status: 200 len: 152 microversion: 2.20 time: 0.207908 Apr 05 12:09:29.629858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 268/507] 10.222.0.36 () {60 vars in 1279 bytes} [Mon Apr 5 12:09:29 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/ips => generated 152 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:29.682040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:29.682745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:29.697921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.698256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.699047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.699533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.849638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:29.850722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:29.881418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.882240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:29.883251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:29.894959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:30.068087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4cc6175-b301-42ba-a4e4-1c7ce6533edb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.222630 Apr 05 12:09:30.073722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 269/508] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:29 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:30.109578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:30.121266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-57f4a746-2609-4c61-b751-051331ed9dd0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.443297 Apr 05 12:09:30.121905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 240/509] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:29 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:30.462318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:30.463228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:30.482918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:30.483753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:30.486057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:30.486821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:30.962817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Action: 'create', calling method: .version_select at 0x7f0100ee5268>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-9640565"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:31.029917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:31.036349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for project 629fa1a565724595a30468e1271ead78. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:31.063727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for user 75522f4b270e42e4b1ce7a6a09beb7ec and project 629fa1a565724595a30468e1271ead78. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:31.065183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1e8f18dc-3f41-4e90-9cc9-e9be499ca06b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1555 microversion: 2.1 time: 0.596761 Apr 05 12:09:31.076041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 241/510] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:30 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1555 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:31.087223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:31.090983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:31.115115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.116480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.118906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.125352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.330668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:09:31.460561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for project 629fa1a565724595a30468e1271ead78. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:31.465492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for user 75522f4b270e42e4b1ce7a6a09beb7ec and project 629fa1a565724595a30468e1271ead78. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:31.502584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-20329673-3bba-48d1-a2a9-faedb1e9f9b2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.057509 Apr 05 12:09:31.510716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 270/511] 10.222.0.36 () {60 vars in 1148 bytes} [Mon Apr 5 12:09:30 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:31.524398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:31.528361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:31.556044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.556706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.557701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.558446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.731980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6bf030d0-a94e-494d-b579-dcd0ffaf27e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.224054 Apr 05 12:09:31.732743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 271/512] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:31 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:31.741693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:31.742510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:31.769787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8312bf7-65a9-4f32-b90e-7fc49ba01d8d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "DELETE /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 204 len: 0 microversion: 2.1 time: 0.692043 Apr 05 12:09:31.772089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.773133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 242/513] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:09:31 2021] DELETE /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:09:31.774637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.787026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.787264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.798846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:31.799696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:31.831328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.831916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:31.834559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:31.835205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.158602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:32.169371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6127d207-3c5e-41cd-bc0a-3e0beefefdcd tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.435336 Apr 05 12:09:32.179762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 272/514] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:31 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.185778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:32.186485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:32.197918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.198728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.199788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.200464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.416776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:32.434939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e8a21dbe-1a94-4049-a67b-90928723250d tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1504 microversion: 2.1 time: 0.652002 Apr 05 12:09:32.446080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 243/515] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:31 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.594107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:32.606613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-64349076-f21f-4b8d-9373-3a97ac89001d tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1555 microversion: 2.1 time: 0.434592 Apr 05 12:09:32.607555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 273/516] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:32 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1555 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:32.745209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:32.746619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:32.755236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.755914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.756793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.757493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.798981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'create', calling method: .version_select at 0x7f0100ee5268>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1222345277"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:32.825054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for project 0fa3ed41777846009e78f090b026e395. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:32.829930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for user 67efaaee9b0744adb38846ef92d9a878 and project 0fa3ed41777846009e78f090b026e395. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:32.904195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0c559c98-8669-4d2d-85bb-178a8088958c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.163050 Apr 05 12:09:32.904917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 244/517] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:32 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:32.937576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:32.938682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:32.949319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.950204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:32.951823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:32.952474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.027881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lazy-loading 'flavor' on Instance uuid 41cc66fe-6283-4798-b54a-9647f39a77ad {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:09:33.185948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for project 0fa3ed41777846009e78f090b026e395. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:33.193969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for user 67efaaee9b0744adb38846ef92d9a878 and project 0fa3ed41777846009e78f090b026e395. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:33.212938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ef06502-1239-405c-a78d-a196c1823abf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.418520 Apr 05 12:09:33.214217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 274/518] 10.222.0.36 () {60 vars in 1148 bytes} [Mon Apr 5 12:09:32 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:33.219420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:33.220311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:33.232839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:33.233578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.234683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:33.235497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.526565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-61b946e3-bd1f-468a-8f87-c94243ddd226 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 202 len: 0 microversion: 2.20 time: 0.593721 Apr 05 12:09:33.527625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 245/519] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:09:32 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:09:33.541659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-c89824b6-6949-47ba-9a01-e5c489428ff7 req-f8e72c58-ea17-4f6b-b86c-51b5a39d334c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eed7b27-b499-4cef-b1c1-2f387e3e690a", "name": "network-vif-plugged", "status": "completed", "tag": "bf171599-2595-48ef-91f6-d69e602260cb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:33.543590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:33.543590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:33.562801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:33.576907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c5d41ec0-3c3b-4a46-b5f9-bd9dded05a2c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.361226 Apr 05 12:09:33.577752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 275/520] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:33 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:33.578435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c89824b6-6949-47ba-9a01-e5c489428ff7 req-f8e72c58-ea17-4f6b-b86c-51b5a39d334c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:33.579193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c89824b6-6949-47ba-9a01-e5c489428ff7 req-f8e72c58-ea17-4f6b-b86c-51b5a39d334c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.585988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1297458369", "imageRef": "15f3210e-2911-4f59-b5c6-f3466ccc07f4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1222345277", "networks": [{"uuid": "548b3d94-5c3c-467f-9182-8efb802d6497"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:33.612857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-c89824b6-6949-47ba-9a01-e5c489428ff7 req-f8e72c58-ea17-4f6b-b86c-51b5a39d334c service nova] Creating event network-vif-plugged:bf171599-2595-48ef-91f6-d69e602260cb for instance 2eed7b27-b499-4cef-b1c1-2f387e3e690a on hv-cinder-78476 Apr 05 12:09:33.618413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-c89824b6-6949-47ba-9a01-e5c489428ff7 req-f8e72c58-ea17-4f6b-b86c-51b5a39d334c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089160 Apr 05 12:09:33.619657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 246/521] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:33.626663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:33.628271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:33.637971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:33.638584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.639571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:33.640177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:33.736855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] validate_networks() for [('548b3d94-5c3c-467f-9182-8efb802d6497', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:09:34.293068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:34.307828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8d6d0ffc-a45b-4fee-9f96-f275d52deef0 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1504 microversion: 2.1 time: 0.686612 Apr 05 12:09:34.314384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 247/522] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:33 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1504 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:34.330497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:34.331218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:34.350873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:34.351386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:34.352254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:34.352753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:34.682505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:34.697424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:34.700268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:34.702009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-da3b0bb2-1e0d-44d4-b81d-062714c67e82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.386592 Apr 05 12:09:34.703370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 248/523] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:09:34 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:34.719389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:34.720064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:34.729909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:34.730260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:34.731059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:34.731552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.021591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:35.031635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-63dead17-201f-4f75-b1e9-5b34751b02c7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1561 microversion: 2.1 time: 0.326992 Apr 05 12:09:35.032422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 249/524] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:34 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1561 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:35.049793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:35.051065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:35.059195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.059735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.060598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.061090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.154398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:09:35.154877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:09:35.155425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:09:35.155882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:09:35.156419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:09:35.184859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.185461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.188647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.188647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.210792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for project 0fa3ed41777846009e78f090b026e395. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:09:35.220753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Getting quotas for user 67efaaee9b0744adb38846ef92d9a878 and project 0fa3ed41777846009e78f090b026e395. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:09:35.234269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:09:35.237266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15f3210e-2911-4f59-b5c6-f3466ccc07f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:09:35.258396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b6de156a-7c85-4b5f-a5d9-8f221ee25406 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.212274 Apr 05 12:09:35.259370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 250/525] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:35 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:35.266484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:35.267545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:35.279013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.279770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.281225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.281649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.395155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6045e06d-ef85-4831-8213-84347052ac2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805038 Apr 05 12:09:35.395742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 276/526] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:09:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:09:35.409938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:35.410543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:35.444868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.445394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.446991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.447494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.650249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:35.662878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0a6e99c5-7e55-49f5-b36c-cf520cbbce99 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1318 microversion: 2.1 time: 0.401498 Apr 05 12:09:35.665351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 251/527] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:35 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:35.694840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:35.695524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:35.717545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.717992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.718887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:35.723830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:35.855459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lazy-loading 'services' on Instance uuid 7c919762-cc2c-4e9f-854d-785eed7cf1df {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:09:36.028095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:36.057111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f3966037-84a7-449f-95b1-93ae5b1d630c tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1462 microversion: 2.1 time: 0.390605 Apr 05 12:09:36.066050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 252/528] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:35 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1462 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:36.087487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0df1f32d-a86e-42bc-9310-c46baa5743a9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:36.091395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0df1f32d-a86e-42bc-9310-c46baa5743a9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:36.184761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b496004-d707-454d-b31d-ef7fa0b842df tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments/86c0d4ce-7685-4515-aa61-c9890b787760" status: 202 len: 0 microversion: 2.1 time: 0.781141 Apr 05 12:09:36.185692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 277/529] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:09:35 2021] DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df/os-volume_attachments/86c0d4ce-7685-4515-aa61-c9890b787760 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:09:36.198885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:36.205452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:36.228124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.228997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.230073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.233625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.305323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0df1f32d-a86e-42bc-9310-c46baa5743a9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:36.318710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0df1f32d-a86e-42bc-9310-c46baa5743a9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1259 microversion: 2.1 time: 0.246374 Apr 05 12:09:36.320817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 253/530] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:36 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:36.340698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:36.342310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:36.361281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.361793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.363383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.363887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.573511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5cb6511c-736b-47f8-b08a-71a56e9ac58f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.251078 Apr 05 12:09:36.574240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 254/531] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:36 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:36.683113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:36.684649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:36.702305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.704339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.705481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.708594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.800835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:36.818058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:36.818058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:36.818058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4fa349ee-0c1a-4979-bd9b-2bd2e87a754f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.628143 Apr 05 12:09:36.822627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 278/532] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:09:36 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:36.829784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-373ae372-3ae2-4cde-b179-ca1210ce48ee req-3f7e4399-b2f3-4fd0-aacd-fd010d0e638a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc", "name": "network-vif-deleted", "tag": "755bd6e5-b716-4a58-a1e2-161e9d54f422"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:36.832909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:09:36.832909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:09:36.843960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-373ae372-3ae2-4cde-b179-ca1210ce48ee req-3f7e4399-b2f3-4fd0-aacd-fd010d0e638a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:36.844722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-373ae372-3ae2-4cde-b179-ca1210ce48ee req-3f7e4399-b2f3-4fd0-aacd-fd010d0e638a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:36.867095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-373ae372-3ae2-4cde-b179-ca1210ce48ee req-3f7e4399-b2f3-4fd0-aacd-fd010d0e638a service nova] Creating event network-vif-deleted:755bd6e5-b716-4a58-a1e2-161e9d54f422 for instance 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc on hv-cinder-78476 Apr 05 12:09:36.874351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-373ae372-3ae2-4cde-b179-ca1210ce48ee req-3f7e4399-b2f3-4fd0-aacd-fd010d0e638a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049123 Apr 05 12:09:36.875340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 279/533] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:09:37.012507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:37.021685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5dc7a07a-60d6-4bbb-95c4-f5f992e27189 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1507 microversion: 2.1 time: 0.343685 Apr 05 12:09:37.022363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 255/534] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:36 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:09:37.084496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:37.085255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:37.098765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.099280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.100143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.100700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.238159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.238801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.239328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lazy-loading 'fault' on Instance uuid 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:09:37.337870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:37.339245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:37.357668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.358220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.359099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.359591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.581603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bcdc8380d7a490393ab556937743e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeef6c5c7cf04cec883416dc0997d657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:37.587453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:37.593708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6341f5b1-72c6-40e6-b098-0fa8d80ee924 tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 200 len: 1304 microversion: 2.1 time: 0.513614 Apr 05 12:09:37.594378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 280/535] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:37 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 1304 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:37.601307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-14f34418-9eeb-4741-a955-61e8157f2a70 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1319 microversion: 2.1 time: 0.267339 Apr 05 12:09:37.601930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 256/536] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:37 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:37.602735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:37.606630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:37.615533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.616413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.617437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.618074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.756260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-de2dca1e-0e1c-479c-bb23-287726a1be4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28169 microversion: 2.1 time: 0.160453 Apr 05 12:09:37.757180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 281/537] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:37 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:09:37.836527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:37.837206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:37.848292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.848794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:37.849835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:37.851014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.165584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:38.183747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:38.185361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:38.192125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3af403f2-4fce-407b-b45d-6a2e7410a74e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.359823 Apr 05 12:09:38.193736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 257/538] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:09:37 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:09:38.613997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:38.614830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] [instance: 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:38.627951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:09:38.628994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:38.638637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.639342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.639630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.639827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.640683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.641172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.641626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.643049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.709094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] HTTP exception thrown: Instance 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc could not be found. Apr 05 12:09:38.710023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] Returning 404 to user: Instance 038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:09:38.711132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-257f8907-e4e9-4993-b901-0bd016b36a5f tempest-VolumesActionsTest-27578588 tempest-VolumesActionsTest-27578588-project] 10.222.0.36 "GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc" status: 404 len: 111 microversion: 2.1 time: 0.101805 Apr 05 12:09:38.715979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 282/539] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:38 2021] GET /compute/v2.1/servers/038a8be8-b71a-4a1e-87e5-30bd2d5fa1bc => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:09:38.769920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:38.771302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:38.790244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.792213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:38.798046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:38.798846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:39.146110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:09:39.160660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-77df4641-3003-43c7-b4b8-c4a6f235c27a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.540777 Apr 05 12:09:39.162003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 258/540] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:09:38 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:09:39.173233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f6ee82-2a5d-401b-900c-601ebe9739db"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:09:39.175544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:09:39.184727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:39.185410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:09:39.186454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:09:39.187099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.583405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-59f27a77-9f7d-40ff-9ab5-dca01b0cbafd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 24.818013 Apr 05 12:10:03.584990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 283/541] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:09:38 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 24821 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:03.590640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:03.591408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:03.600454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.600968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.601816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.602336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.778018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-83052a01-a75b-430c-b1a6-874d282946e2 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "POST /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 24.614403 Apr 05 12:10:03.779093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 259/542] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:09:39 2021] POST /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a/os-volume_attachments => generated 194 bytes in 24616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:03.784582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:03.785544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:03.793840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.794377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.795265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.795800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.933218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:03.945093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:03.946844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:03.948071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-395807dd-ad58-44c6-9fd4-840b5fbbeb6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.361690 Apr 05 12:10:03.948671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 284/543] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:03 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:03.967173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:03.968099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:03.979018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.979523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:03.980367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:03.980852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.043039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:04.053176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b908237c-8d4a-4480-8fbf-e44afd4a0f8a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.272913 Apr 05 12:10:04.054162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 260/544] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:03 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:04.087362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:04.242908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f279674d-f08d-4cfc-a4ca-b8f8cbcb4563 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 204 len: 0 microversion: 2.1 time: 0.279311 Apr 05 12:10:04.243821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 285/545] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:03 2021] DELETE /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:04.253614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:04.254964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:04.268768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.270449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.271641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.272414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.548034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:04.558944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3f706578-5ac8-455e-ad10-b8a2509519a0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1506 microversion: 2.1 time: 0.310205 Apr 05 12:10:04.559839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 261/546] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:04 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:04.597165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:04.598986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:04.611078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.612119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.613016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.614061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.728131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a4e1f11d-c6e4-4a26-a1a5-1682892650b4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.135493 Apr 05 12:10:04.728821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 286/547] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:04 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:04.814708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-e9b34c7d-13ca-4494-a073-19369c991d7a req-14bb46a6-900e-4030-8105-ad2f22368a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:04.818630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:04.818630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:04.829895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e9b34c7d-13ca-4494-a073-19369c991d7a req-14bb46a6-900e-4030-8105-ad2f22368a9c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.830426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e9b34c7d-13ca-4494-a073-19369c991d7a req-14bb46a6-900e-4030-8105-ad2f22368a9c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.849105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-e9b34c7d-13ca-4494-a073-19369c991d7a req-14bb46a6-900e-4030-8105-ad2f22368a9c service nova] Creating event network-changed:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:10:04.854332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-e9b34c7d-13ca-4494-a073-19369c991d7a req-14bb46a6-900e-4030-8105-ad2f22368a9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044327 Apr 05 12:10:04.855005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 262/548] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:04.969210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:04.969999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:04.978895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.979417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:04.980279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:04.980755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.072022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:05.073853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:05.085777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.086615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.087689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.088376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.395927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:05.409369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-832e5f4a-340b-456a-a990-bc041baa2e26 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.341983 Apr 05 12:10:05.411571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 263/549] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:05 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:05.580169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:05.580845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:05.589564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.590078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.590958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.591452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.617061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:05.632769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:05.634937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:05.637333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7264db2b-8d94-4b08-b051-4f4ea12a36f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.672745 Apr 05 12:10:05.656838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 287/550] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:04 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:05.741998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:05.743444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:05.752525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.753327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.754552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:05.755267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:05.840880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:05.851181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-06e3c91d-3f47-451c-aed5-5924a9eb1528 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1506 microversion: 2.1 time: 0.274965 Apr 05 12:10:05.852118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 264/551] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:05 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:05.917636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d9384cfb-e170-479c-90e5-82a231b3b8e3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.180252 Apr 05 12:10:05.918443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 288/552] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:05 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:06.429517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:06.430850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:06.441447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.442170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:06.443053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.443554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:06.660367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:06.661791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:06.670495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.676323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:06.677407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.678068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:06.704209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:06.724988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8aa40bb0-88eb-42af-80ad-41fa9818b8f1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.297307 Apr 05 12:10:06.737409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 265/553] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:06 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:06.876547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:06.876547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:06.899068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.899897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:06.901440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:06.902631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:07.187546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:07.205358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:07.210110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:07.213790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a69c87c8-c38b-431f-9bad-a0dc24305a40 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.558476 Apr 05 12:10:07.214727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 289/554] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:06 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:07.221796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:07.223635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:07.232521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:07.249563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e2a20f60-5a31-42f6-be1e-dc23f27b3fd0 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1506 microversion: 2.1 time: 0.381059 Apr 05 12:10:07.250903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 266/555] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:06 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:07.260771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:07.261513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:07.262576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:07.263247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:07.616751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ae7b81cf-f1c4-4f0a-9e66-591adf2f8938 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.399399 Apr 05 12:10:07.621450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 290/556] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:07 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:07.744557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:07.745385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:07.754370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:07.754989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:07.756037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:07.756820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.005215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:08.014312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-932ee06d-83a9-4ec8-9e9c-f21cafb95c07 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.273750 Apr 05 12:10:08.015017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 267/557] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:07 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:08.241745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:08.243138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:08.271490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:08.272145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:08.285878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.287027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.288502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.289678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.289859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.290426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.295651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.296185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.741179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:08.752663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e27ed922-2975-466f-9379-d9dd3aa0be59 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1506 microversion: 2.1 time: 0.487553 Apr 05 12:10:08.754188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 268/558] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:08 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:08.759182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:08.760424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:08.779353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.779817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.780845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:08.781348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:08.833095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:08.849843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:08.851176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:08.855303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6aa32300-80e0-4e27-935d-8f67fad3d95a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.618415 Apr 05 12:10:08.859103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 291/559] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:08 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:09.036041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:09.036976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:09.055968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.057820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.059832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.062358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.140520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cc892b1b-af0a-424f-966e-b3f0a88a7c94 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.384657 Apr 05 12:10:09.141357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 269/560] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:08 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:09.366922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-88328483-4b64-48a0-82dd-2cf546c2a256 req-8775b52e-dcae-45a4-b316-0d2b6fbf75ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "name": "network-vif-plugged", "status": "completed", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:09.368910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:09.368910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:09.381062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-88328483-4b64-48a0-82dd-2cf546c2a256 req-8775b52e-dcae-45a4-b316-0d2b6fbf75ed service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.381824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-88328483-4b64-48a0-82dd-2cf546c2a256 req-8775b52e-dcae-45a4-b316-0d2b6fbf75ed service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.405024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-88328483-4b64-48a0-82dd-2cf546c2a256 req-8775b52e-dcae-45a4-b316-0d2b6fbf75ed service nova] Creating event network-vif-plugged:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:10:09.413261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-88328483-4b64-48a0-82dd-2cf546c2a256 req-8775b52e-dcae-45a4-b316-0d2b6fbf75ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050858 Apr 05 12:10:09.414750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 270/561] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:09.775117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:09.777338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:09.801029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.802570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.804057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.804764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.839513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:09.855074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-813f0895-70f0-4696-bbd5-fa21f0743636 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.825327 Apr 05 12:10:09.856118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 292/562] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:09 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:09.876287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:09.877093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:09.904329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.906696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:09.907743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:09.913994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:10.040471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:10.051336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-14e702ae-4e3d-4cff-82fc-04a4555b59c1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 200 len: 1464 microversion: 2.1 time: 0.282126 Apr 05 12:10:10.051336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 271/563] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:09 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:10.056838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-7b6d00a4-11bb-4b86-a5ae-2d3f1860becd req-4198cb0f-860b-4675-a5aa-b60eaad8fc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1", "name": "network-vif-deleted", "tag": "245fb830-1f01-4e19-b34c-4fcae22ec0c3"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:10.058470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:10.058470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:10.068615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7b6d00a4-11bb-4b86-a5ae-2d3f1860becd req-4198cb0f-860b-4675-a5aa-b60eaad8fc98 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:10.069119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7b6d00a4-11bb-4b86-a5ae-2d3f1860becd req-4198cb0f-860b-4675-a5aa-b60eaad8fc98 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:10.111441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-7b6d00a4-11bb-4b86-a5ae-2d3f1860becd req-4198cb0f-860b-4675-a5aa-b60eaad8fc98 service nova] Creating event network-vif-deleted:245fb830-1f01-4e19-b34c-4fcae22ec0c3 for instance 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 on hv-cinder-78476 Apr 05 12:10:10.121668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-7b6d00a4-11bb-4b86-a5ae-2d3f1860becd req-4198cb0f-860b-4675-a5aa-b60eaad8fc98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068138 Apr 05 12:10:10.123249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 272/564] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:10.159804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:10.164309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:10.184743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:10.185678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:10.187800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:10.188523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:10.317793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:10.327900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:10.329942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:10.331457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3fa00539-267c-40cf-a32e-521fdaf42337 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.459642 Apr 05 12:10:10.332365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 293/565] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:09 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:10.570498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db3af782-adb6-4011-b242-b2c047243196 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.419562 Apr 05 12:10:10.574710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 273/566] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:10 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:10:10.874837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:10.875647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:10.884890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:10.886005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:10.887093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:10.887781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.070014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:11.070829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:11.102401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.103330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.104416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.105058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.212267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] HTTP exception thrown: Instance 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 could not be found. Apr 05 12:10:11.213235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Returning 404 to user: Instance 3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:11.214580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2e8ca79a-e719-460e-980b-cebcafb8f9e5 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1" status: 404 len: 111 microversion: 2.1 time: 0.149174 Apr 05 12:10:11.215371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 274/567] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:11 2021] GET /compute/v2.1/servers/3e9ef56f-ee0a-42ba-a343-c3a75f29dbf1 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:11.226860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:11.227434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:11.241114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.241622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.242512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.243170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.311450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:11.321586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-524f6420-981c-480a-8943-3a2a49f1a46f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.450553 Apr 05 12:10:11.322304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 294/568] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:10 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:11.347137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:11.351477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:11.352269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:11.375344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.376760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.381317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.382086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.516579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-37fdac1a-c745-4a36-b3a7-6221cfdd3512 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 204 len: 0 microversion: 2.1 time: 0.296358 Apr 05 12:10:11.517331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 275/569] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:11 2021] DELETE /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 05 12:10:11.537648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:11.538839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:11.551789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.552308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.553194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.553676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.671471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:11.684255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:11.686155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:11.687556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10718959-37be-45a4-b804-8233cd14b694 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.340300 Apr 05 12:10:11.700162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 295/570] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:11 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:11.705384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:11.706714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:11.715142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.715881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.716892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:11.717536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:11.842807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:11.852877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8a3a7d82-29e6-4e48-82fb-d1d97dde9921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.150811 Apr 05 12:10:11.854461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2867ab90-802d-4230-856a-950fafec02b7 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.331371 Apr 05 12:10:11.857593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 276/571] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:11 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:11.858232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 296/572] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:11 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:12.341157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:12.341831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:12.351450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.351956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:12.352811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.353520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:12.585201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:12.595050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fd2f3f7d-5731-48c9-97bd-5b75d1f941e3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.257959 Apr 05 12:10:12.602307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 277/573] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:12 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:12.712442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:12.714452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:12.729784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.731078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:12.732103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.732824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:12.868321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:12.869862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:12.896244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.897165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:12.900246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:12.900965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.169758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3c651cd0-38ec-4c28-8c22-065d841c1f10 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.307988 Apr 05 12:10:13.169914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:13.170998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 278/574] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:12 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:13.184354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:13.187735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:13.197625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:13.200500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.201062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.202006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.202628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.211039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:13.212316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-efb619e1-96b8-43ed-aaaf-cc2cfee846bf tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.508348 Apr 05 12:10:13.226569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 297/575] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:12 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:13.499426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:13.510639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e4909a81-f01b-47a0-bd58-69c6ab812625 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.337277 Apr 05 12:10:13.511547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 279/576] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:13 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:13.555799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:13.556518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:13.566692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.567377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.568590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.569106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.621320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:13.622619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:13.631554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.632297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.633228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:13.633651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:13.812114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'services' on Instance uuid 2eed7b27-b499-4cef-b1c1-2f387e3e690a {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:13.879502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:13.888611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f369be22-2ce4-4f0d-b3b6-2bf88fc0487a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.273581 Apr 05 12:10:13.907388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 280/577] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:13 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:13.998534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-96ad1ca8-f668-4cb8-835b-844d9670e211 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a/os-volume_attachments/90f6ee82-2a5d-401b-900c-601ebe9739db" status: 202 len: 0 microversion: 2.1 time: 0.447241 Apr 05 12:10:13.999833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 298/578] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:10:13 2021] DELETE /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a/os-volume_attachments/90f6ee82-2a5d-401b-900c-601ebe9739db => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:10:14.183764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:14.184853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:14.192969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.193587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.194312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.194918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.237529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:14.239293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:14.249190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.250406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.251614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.252156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.337589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9b6372fb-f3f8-4e7c-aa91-9e81743edaa7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.157563 Apr 05 12:10:14.341679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 281/579] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:14 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:10:14.492008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:14.502311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:14.504571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:14.505902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b869513-064a-41d7-b846-4dc6fb92fd6c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1745 microversion: 2.20 time: 0.273161 Apr 05 12:10:14.506446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 299/580] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:14 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:14.531777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:14.532831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:14.542290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.543391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.544239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.544729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.906204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:14.907225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:14.916552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.917694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.918815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:14.919789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:14.928548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:14.945963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24522e0b-12a1-46d1-ae70-30c916f65c4f tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.418650 Apr 05 12:10:14.946922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 282/581] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:14 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:15.198726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-1ae585ec-b60b-4f8d-8aea-c68fccf61a60 req-ed6b1b8e-fed8-45b5-ac37-cf6a784949f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "name": "network-vif-plugged", "status": "completed", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:15.198726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:15.198726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:15.215526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1ae585ec-b60b-4f8d-8aea-c68fccf61a60 req-ed6b1b8e-fed8-45b5-ac37-cf6a784949f0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.216074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1ae585ec-b60b-4f8d-8aea-c68fccf61a60 req-ed6b1b8e-fed8-45b5-ac37-cf6a784949f0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.227256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:15.241147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f027fd05-fb6b-4c82-b426-fe07c443bd5d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.339006 Apr 05 12:10:15.241791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 300/582] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:14 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:15.266497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-1ae585ec-b60b-4f8d-8aea-c68fccf61a60 req-ed6b1b8e-fed8-45b5-ac37-cf6a784949f0 service nova] Creating event network-vif-plugged:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:10:15.283236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-1ae585ec-b60b-4f8d-8aea-c68fccf61a60 req-ed6b1b8e-fed8-45b5-ac37-cf6a784949f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090527 Apr 05 12:10:15.288458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 283/583] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:15.350459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:15.351623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:15.359893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.360402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.361254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.361745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.470263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ee1bea47-74c5-4262-a222-1b2fca56e000 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.124555 Apr 05 12:10:15.471916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 301/584] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:15 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:15.528196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:15.530115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:15.540032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.540851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.541921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.542624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.859173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:15.875173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:15.879208 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:15.880971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e179ba69-c8ab-44d3-ab0a-4d3170cffc0b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.357826 Apr 05 12:10:15.893349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 284/585] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:15 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:15.966589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:15.967753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:15.979746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.981307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:15.982762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:15.983511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.248812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:16.260942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:16.261201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c477cf36-fd3f-4ba6-b718-689fd3901ffa tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.299993 Apr 05 12:10:16.261757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:16.272581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 302/586] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:15 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:16.272821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.272821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.272821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.272821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.482411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:16.484223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:16.502839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.503268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.504177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.504671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.560680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:16.583672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db73935b-b204-4bd5-a2c4-0c7a8e48cb77 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1359 microversion: 2.1 time: 0.316590 Apr 05 12:10:16.584351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 285/587] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:16 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:16.621343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fa85cf90-b085-4650-b1ee-b029df2936da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.142622 Apr 05 12:10:16.622351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 303/588] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:16 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:16.901958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:16.902637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:16.911403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.912183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:16.913250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:16.913813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.297583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:17.299676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:17.346606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.348085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.349012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.349747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.492237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:17.503534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:17.505535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:17.507236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b4f68f6-e265-4a2a-a458-dff4f6f96423 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.609561 Apr 05 12:10:17.508273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 286/589] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:16 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:17.602383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:17.603814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:17.613212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.614745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.615851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.616705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.687961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:17.700190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c8e9dfdf-aab6-4845-bda4-6a248d74757b tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.422721 Apr 05 12:10:17.701184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 304/590] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:17 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:17.707360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:17.708622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:17.718722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.719485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.720494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.721135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.854867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ef99fa82-3b50-4227-9233-ee15dabe0afc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.152061 Apr 05 12:10:17.855922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 305/591] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:17 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:17.864806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:17.865470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:17.889237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.890446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.891335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.891838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.898226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:17.909334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2fe86cd8-7d3c-4ec8-8272-cc0321d7ac44 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1548 microversion: 2.1 time: 0.311589 Apr 05 12:10:17.922983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 287/592] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:17 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:17.932089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:17.941398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:17.953227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.953959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:17.955063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:17.955734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.033922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:18.258929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0c68eced-ca49-45d9-9e5f-82372af61fce tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 204 len: 0 microversion: 2.1 time: 0.398043 Apr 05 12:10:18.259591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 306/593] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:17 2021] DELETE /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:18.269032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:18.269838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:18.284039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.290410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.291013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.291906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.292420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.293959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-55085431-bad2-4dcf-bdc8-59930ac4bb9b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1548 microversion: 2.1 time: 0.366299 Apr 05 12:10:18.294624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 288/594] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:17 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1548 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:18.310982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:18.314743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:18.314743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:18.316514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.317577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Searching by: {'deleted': False, 'project_id': '0fa3ed41777846009e78f090b026e395'} {{(pid=98311) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 05 12:10:18.324402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.324941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.325940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.326631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.460919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.multi_cell_list [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98311) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 05 12:10:18.581355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a0b23a53-bb2a-4aff-a4d8-328da0c23c5f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.273999 Apr 05 12:10:18.582101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 289/595] 10.222.0.36 () {58 vars in 1115 bytes} [Mon Apr 5 12:10:18 2021] GET /compute/v2.1/servers => generated 343 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:18.602872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:18.603983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:18.616077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.616901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.618439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.619372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.725202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.739630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ff75b473-257e-4149-b397-e071f0cc25a4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1513 microversion: 2.1 time: 0.475060 Apr 05 12:10:18.740284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 307/596] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:18 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1513 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:18.761106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:18.761990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:18.771976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.772566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.773498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.774332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.899400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.923628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.925651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:18.927484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b81ddacc-2941-40c9-b5f5-b526b7e76b25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.333586 Apr 05 12:10:18.928541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 290/597] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:18 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:18.933828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:18.934788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:18.944661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.945177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:18.945177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:18.945177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.313636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:19.323863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6b044bdc-d1c5-42d5-ba16-2723d15c8ea1 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1521 microversion: 2.1 time: 0.394139 Apr 05 12:10:19.327978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 291/598] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:18 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:19.337243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:19.339349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:19.348556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.349363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.350502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.351213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.517102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc2f7b1b-dfcb-44da-9030-d99c5fd72ef7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.187132 Apr 05 12:10:19.517989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 292/599] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:19 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:19.615732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:19.626093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e11ae98e-c340-4c8d-98cb-5d9176326a37 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1548 microversion: 2.1 time: 0.873431 Apr 05 12:10:19.637753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 308/600] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:18 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1548 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:19.759216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:19.760117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:19.774177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.776118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.777669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.779083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.952531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:19.953561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:19.972239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.973127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:19.974284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:19.974971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.056170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:20.068549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1a373771-7b4d-4e5c-be02-1a8dfe8a0638 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1513 microversion: 2.1 time: 0.313519 Apr 05 12:10:20.069725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 293/601] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:19 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:20.194329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-ef505645-1c7b-468e-9134-5b877cb9485e req-7e8ac8a8-7a15-4667-88b7-19a31e550ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c919762-cc2c-4e9f-854d-785eed7cf1df", "name": "network-vif-deleted", "tag": "98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:20.196293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:20.196293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:20.217673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-ef505645-1c7b-468e-9134-5b877cb9485e req-7e8ac8a8-7a15-4667-88b7-19a31e550ca5 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:20.218355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-ef505645-1c7b-468e-9134-5b877cb9485e req-7e8ac8a8-7a15-4667-88b7-19a31e550ca5 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.255930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-ef505645-1c7b-468e-9134-5b877cb9485e req-7e8ac8a8-7a15-4667-88b7-19a31e550ca5 service nova] Creating event network-vif-deleted:98f5ec5e-d25e-4d4a-a2bc-e5c7cfe4815f for instance 7c919762-cc2c-4e9f-854d-785eed7cf1df on hv-cinder-78476 Apr 05 12:10:20.270073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-ef505645-1c7b-468e-9134-5b877cb9485e req-7e8ac8a8-7a15-4667-88b7-19a31e550ca5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079544 Apr 05 12:10:20.274988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 294/602] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:20.343294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:20.344078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:20.352653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:20.353175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.354191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:20.354547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.459098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:20.474216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:20.477150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:20.479074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f34cf60-81ff-4080-aa6c-32800725f1f6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.533199 Apr 05 12:10:20.480735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 309/603] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:19 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:20.533280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61591d1ef834006b4b0b13c2a3efde5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0903b4e64774f679042704eb580949d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:20.535267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:20.536514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:20.543220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6178f60b-6ccd-45d5-8b16-faef4779d1fb tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 200 len: 1307 microversion: 2.1 time: 0.204946 Apr 05 12:10:20.544142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 295/604] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:20 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:20.551346 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:20.552676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.554057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:20.555159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:20.733770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3ba0ca6e-7cb6-4da3-ace8-33eb7c2ca248 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.205712 Apr 05 12:10:20.739878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 310/605] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:20 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:21.088161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:21.089159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:21.101169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.101958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.103028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.103681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.336643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:21.346231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2370a78d-a29f-4d67-8a82-b06950043d30 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1513 microversion: 2.1 time: 0.262308 Apr 05 12:10:21.346882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 296/606] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:21 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:21.501057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:21.501987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:21.519615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.520319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.521205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.522420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.564416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:21.565259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] [instance: 7c919762-cc2c-4e9f-854d-785eed7cf1df] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:21.582945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.583516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.584341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.591095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.732191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] HTTP exception thrown: Instance 7c919762-cc2c-4e9f-854d-785eed7cf1df could not be found. Apr 05 12:10:21.732191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] Returning 404 to user: Instance 7c919762-cc2c-4e9f-854d-785eed7cf1df could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:21.732191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6497479c-8d1d-4d86-8298-114f1ec1e4a8 tempest-ServerRescueNegativeTestJSON-1456746117 tempest-ServerRescueNegativeTestJSON-1456746117-project] 10.222.0.36 "GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df" status: 404 len: 111 microversion: 2.1 time: 0.169750 Apr 05 12:10:21.732191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 297/607] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:21 2021] GET /compute/v2.1/servers/7c919762-cc2c-4e9f-854d-785eed7cf1df => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:21.758333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:21.758333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:21.771694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.772096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.772981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:21.773486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:21.964822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-029136ec-f6ab-48bc-bd35-3663f3136ab8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.218156 Apr 05 12:10:21.977117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 298/608] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:21 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:22.035698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf960759-94e1-4fc4-84bc-48ecd6078733"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:22.037136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:22.047057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:22.047560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:22.048623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:22.064266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:22.327184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:22.340057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:22.346187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:22.351763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-61d00cb6-8b2f-41c6-9bdd-3ab77cc03923 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.851928 Apr 05 12:10:22.352382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 311/609] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:21 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:22.388118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:22.388803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:22.416301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:22.416818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:22.417683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:22.418212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:22.742556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7bf5dd14-b760-4db8-bde4-86406362df45 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713033 Apr 05 12:10:22.743482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 299/610] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:10:22 2021] POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:22.770865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:22.786759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-02c40e6b-6c54-4cc8-8085-141cdbc1036a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1471 microversion: 2.1 time: 0.420205 Apr 05 12:10:22.798523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 312/611] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:22 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:22.811433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-7b64530d-940c-4608-b76f-704985c16751 req-8b3a30f5-e8e3-4d97-bc4b-59f7f57c1734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eed7b27-b499-4cef-b1c1-2f387e3e690a", "name": "network-vif-deleted", "tag": "bf171599-2595-48ef-91f6-d69e602260cb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:22.813507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:22.813507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:22.833273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7b64530d-940c-4608-b76f-704985c16751 req-8b3a30f5-e8e3-4d97-bc4b-59f7f57c1734 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:22.834053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7b64530d-940c-4608-b76f-704985c16751 req-8b3a30f5-e8e3-4d97-bc4b-59f7f57c1734 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:22.855782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-7b64530d-940c-4608-b76f-704985c16751 req-8b3a30f5-e8e3-4d97-bc4b-59f7f57c1734 service nova] Creating event network-vif-deleted:bf171599-2595-48ef-91f6-d69e602260cb for instance 2eed7b27-b499-4cef-b1c1-2f387e3e690a on hv-cinder-78476 Apr 05 12:10:22.866735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-7b64530d-940c-4608-b76f-704985c16751 req-8b3a30f5-e8e3-4d97-bc4b-59f7f57c1734 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060932 Apr 05 12:10:22.874815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 300/612] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:22.984515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:22.985823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:22.999118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.002608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.004222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.007371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.245396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cb9b155e-52c2-4e48-82db-c0420435c473 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.264522 Apr 05 12:10:23.246108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 313/613] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:22 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:23.372924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:23.373977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:23.386306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.386753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.387612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.388106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.806827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:23.807583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:23.822893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.831488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.833396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.834120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.990761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:23.991450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:23.992094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'fault' on Instance uuid 2eed7b27-b499-4cef-b1c1-2f387e3e690a {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:24.041679 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:24.066413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:24.081064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:24.082475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fefa61b1-e2bb-42f9-830e-3cf5e1d9192b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.714421 Apr 05 12:10:24.083110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 301/614] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:23 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:24.211952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:24.228542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cfa70719-02f8-40cf-980e-39ec1ce452eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 200 len: 1308 microversion: 2.1 time: 0.426736 Apr 05 12:10:24.229470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 314/615] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:23 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:24.257865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:24.259230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:24.279255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:24.279956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:24.281083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:24.281806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:24.464827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3ac480b6-4814-4daa-832c-8eb636847bea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.211235 Apr 05 12:10:24.469205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 302/616] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:24 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:25.110735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:25.111694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:25.138880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.139395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.140254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.140746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.251491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:25.252330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 2eed7b27-b499-4cef-b1c1-2f387e3e690a] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:25.277907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.278452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.279332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.279831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.456396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Instance 2eed7b27-b499-4cef-b1c1-2f387e3e690a could not be found. Apr 05 12:10:25.458070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 404 to user: Instance 2eed7b27-b499-4cef-b1c1-2f387e3e690a could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:25.459359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-34a58ee6-8b93-4cec-b154-df9c13a831f4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a" status: 404 len: 111 microversion: 2.1 time: 0.212404 Apr 05 12:10:25.484689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 303/617] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:25 2021] GET /compute/v2.1/servers/2eed7b27-b499-4cef-b1c1-2f387e3e690a => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:25.499991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:25.501415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:25.532445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.537494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.542099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:25.542889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:25.798155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-360b333a-58c7-4eb1-a9c6-f85406780acc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.311502 Apr 05 12:10:25.805486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 304/618] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:25 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:26.509719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:26.525695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:26.531711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:26.540197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-41d7fb99-9bd4-4cb6-87fa-9f176bac3e2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 1.442710 Apr 05 12:10:26.541092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 315/619] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:25 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:26.814671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:26.815360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:26.834159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:26.836007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:26.837100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:26.838718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.019467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aa7bb6ca-cab8-4360-912f-c91a76f276da tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.209157 Apr 05 12:10:27.023901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 305/620] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:26 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:27.099683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:27.100503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:27.137243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.138016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.140361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.143307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.263737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:27.442401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-944dbc0a-6863-4e9a-8141-decef551dd76 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 204 len: 0 microversion: 2.1 time: 0.346474 Apr 05 12:10:27.443735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 316/621] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:27 2021] DELETE /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:27.453139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:27.454277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:27.465177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.466765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.468008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.468711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.562994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:27.564355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:27.578810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.579649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.580822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:27.581895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:27.801730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:27.811622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-63d668dd-a324-4335-95fe-14564e1d70eb tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1513 microversion: 2.1 time: 0.363432 Apr 05 12:10:27.826537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 306/622] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:27 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:28.032179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:28.034855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:28.057935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:28.058777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:28.059803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:28.060447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:28.235413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8e0acb04-cb42-44a9-ad1f-58869c0e155f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.207031 Apr 05 12:10:28.236127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 307/623] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:28 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:10:28.844674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:28.845977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:28.857978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:28.873234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:28.874059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:28.876642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:28.877334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:28.880996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:28.889138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:28.891028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-26c0c1be-073e-427d-9ea2-b5e2056c4e46 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 1.334111 Apr 05 12:10:28.896671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 317/624] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:27 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:29.248365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:29.254481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:29.280070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:29.281126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:29.283013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:29.284696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:29.343455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:29.357207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23865481-b5cc-44db-b717-7b2a025830d1 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1513 microversion: 2.1 time: 0.516908 Apr 05 12:10:29.361166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 308/625] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:28 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:29.920279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:29.921032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:29.931493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:29.932426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:29.933444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:29.934088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:30.308653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:30.323100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:30.324770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:30.326064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e057628d-7eae-4b4b-87b4-607543c4e094 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.412928 Apr 05 12:10:30.326774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 309/626] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:29 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:30.378773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:30.379870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:30.392991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:30.397731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:30.398738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:30.399859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:30.792685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-301442b4-ae39-4253-89d3-465bf694563a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 1.547852 Apr 05 12:10:30.794078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 318/627] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:29 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:31.204544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:31.216570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-027799c6-e669-448d-bb7f-c5a76b192e67 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1513 microversion: 2.1 time: 0.841994 Apr 05 12:10:31.219848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 310/628] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:30 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1513 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:31.350998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:31.352054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:31.371975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:31.373231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:31.374726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:31.375369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:31.805656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:31.806953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:31.827429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:31.829129 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:31.830378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:31.831776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:32.008325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f346802b-9a89-49b4-8c29-25daa69e71b8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.206691 Apr 05 12:10:32.009422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 311/629] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:31 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:32.243216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:32.244125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:32.269376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:32.270397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:32.272101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:32.272781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:32.401020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:32.414381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:32.427103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:32.428449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6797bb88-b4a7-430e-a706-468549c576cc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 1.083296 Apr 05 12:10:32.429118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 319/630] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:31 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:33.021228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:33.022888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:33.043316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.055710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.063173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.064005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.277381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-964d4616-0d2f-49a6-83d1-55a5ce14617c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.260398 Apr 05 12:10:33.278720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 320/631] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:33 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:33.291425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:33.303890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-72471fdf-0278-456b-804d-6e2c2f9abbad tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1513 microversion: 2.1 time: 1.070405 Apr 05 12:10:33.306495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 312/632] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:32 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1513 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:33.439351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-cdf28610-dd6d-48d4-bed2-617f50aa71d3 req-fd28676d-3410-4cb1-affc-82e000931b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b76dc471-47cc-4b87-a3f0-8309af9aa790", "name": "network-vif-deleted", "tag": "c0b82022-589f-4b45-a8d6-945f8492e0e0"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:33.443567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:33.443567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:33.449578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:33.450505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:33.461457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cdf28610-dd6d-48d4-bed2-617f50aa71d3 req-fd28676d-3410-4cb1-affc-82e000931b75 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.462261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cdf28610-dd6d-48d4-bed2-617f50aa71d3 req-fd28676d-3410-4cb1-affc-82e000931b75 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.462921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.463431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.464267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.480025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.499082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-cdf28610-dd6d-48d4-bed2-617f50aa71d3 req-fd28676d-3410-4cb1-affc-82e000931b75 service nova] Creating event network-vif-deleted:c0b82022-589f-4b45-a8d6-945f8492e0e0 for instance b76dc471-47cc-4b87-a3f0-8309af9aa790 on hv-cinder-78476 Apr 05 12:10:33.505554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-cdf28610-dd6d-48d4-bed2-617f50aa71d3 req-fd28676d-3410-4cb1-affc-82e000931b75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070712 Apr 05 12:10:33.506760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 321/633] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:33.513293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:33.514299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:33.523151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.523795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.525141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:33.525847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:33.829941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:33.841533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:33.843494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:33.844919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5b1e5015-2fe6-4ae7-9a79-078b4b596400 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.400392 Apr 05 12:10:33.845549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 313/634] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:33 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:33.911326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:33.925468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bd62742b-eeb5-45b7-adc2-0558fd2f9dd0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1594 microversion: 2.1 time: 0.417168 Apr 05 12:10:33.929016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 322/635] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:33 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1594 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:34.291135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:34.292207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:34.305963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.306695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.307688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.308269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.322214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:34.322986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:34.350492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.357671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.360830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.365085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.610459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.611816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.613052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'fault' on Instance uuid b76dc471-47cc-4b87-a3f0-8309af9aa790 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:34.623614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cf15e700-6f10-42f5-829a-67ad7b225f0f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.336939 Apr 05 12:10:34.630883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 314/636] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:34 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:34.830624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:34.845951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a253e8d-e617-444f-aa2d-4672105f81c8 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 200 len: 1308 microversion: 2.1 time: 0.528694 Apr 05 12:10:34.850420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 323/637] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:34 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:34.866931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:34.867785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:34.877740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.878698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:34.879759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:34.881400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:35.297127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:35.311851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:35.315951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:35.321781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-15214247-2aa6-43f0-a5b0-e2881c468aad tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.459711 Apr 05 12:10:35.326043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 315/638] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:34 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:35.636738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:35.638229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:35.652039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:35.653242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:35.655793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:35.656300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:35.711260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e2a9743-f849-4bdf-968e-ce8a2fa3e6ad tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Action: 'create', calling method: .version_select at 0x7f0100c61950>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-772625685"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:35.814564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8338b9db-b440-40f0-9442-544615224e26 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.182313 Apr 05 12:10:35.815710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 316/639] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:35 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:35.869235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:35.870085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: b76dc471-47cc-4b87-a3f0-8309af9aa790] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:35.896653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:35.897210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:35.898071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:35.899307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.005232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Instance b76dc471-47cc-4b87-a3f0-8309af9aa790 could not be found. Apr 05 12:10:36.007399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 404 to user: Instance b76dc471-47cc-4b87-a3f0-8309af9aa790 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:36.008347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-da00b6a6-6b5e-4b3f-a220-0eafc4e1ec5c tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790" status: 404 len: 111 microversion: 2.1 time: 0.143718 Apr 05 12:10:36.009182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 317/640] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:35 2021] GET /compute/v2.1/servers/b76dc471-47cc-4b87-a3f0-8309af9aa790 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:10:36.020376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:36.020762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:36.042098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.042835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.048414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.048962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.217267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:36.475331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a4410d5a-e6b1-4af1-bc66-d499b7513fa0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 204 len: 0 microversion: 2.1 time: 0.459840 Apr 05 12:10:36.479520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 318/641] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:36 2021] DELETE /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:36.488254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:36.489051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:36.504369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.504993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.505879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.506436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.558059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e2a9743-f849-4bdf-968e-ce8a2fa3e6ad tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.047021 Apr 05 12:10:36.559347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 324/642] 10.222.0.36 () {60 vars in 1145 bytes} [Mon Apr 5 12:10:35 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1049 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 12:10:36.565924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:36.566940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:36.585484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.588397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.592104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:36.592755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:36.888491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:36.900517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:36.907647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:36.911436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1102323f-afa0-4c40-9b46-871bd32e260b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.430626 Apr 05 12:10:36.914810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 319/643] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:36 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:36.927184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-77e3b4fa-6f52-49eb-8df1-fbbcad1ec4f2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100579598>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:37.191167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-77e3b4fa-6f52-49eb-8df1-fbbcad1ec4f2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 200 len: 344 microversion: 2.1 time: 0.274439 Apr 05 12:10:37.192159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 320/644] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:36 2021] GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:37.197014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:37.198073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:37.224635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:37.224635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:37.225575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:37.226643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:37.368681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:37.381827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-522a6103-afff-4b6c-95bf-31ec8eb490e5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1513 microversion: 2.1 time: 0.820974 Apr 05 12:10:37.382715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 325/645] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:36 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1513 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:37.399715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1408956565", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-9640565", "security_groups": [{"name": "tempest-secgroup-smoke-398527571"}], "block_device_mapping_v2": [{"uuid": "1ebc0314-6a02-4518-a1c8-225abbfddbb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e4dca9-c22e-4b2f-b50e-39573f778a69"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:37.423231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a4c3668-c84a-4dbc-b4d7-80c366c3bf4c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.229694 Apr 05 12:10:37.424241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 321/646] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:37 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:37.811356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] validate_networks() for [('a3e4dca9-c22e-4b2f-b50e-39573f778a69', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:10:37.936161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:37.936930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:37.952057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:37.952814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:37.954533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:37.955053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:38.938560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:38.953936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:38.959980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:38.961461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-90746b5e-9f1e-4012-becc-614515817039 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 1.031989 Apr 05 12:10:38.974515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 322/647] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:37 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:38.974515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b115e7c-e219-46ea-ab59-63e2e790d04c tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100579598>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:39.010952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:10:39.011694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:10:39.012433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:10:39.013092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:10:39.013754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:10:39.042447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.042965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.043850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.044342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.086369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:10:39.131353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for user 75522f4b270e42e4b1ce7a6a09beb7ec and project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:10:39.156752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b115e7c-e219-46ea-ab59-63e2e790d04c tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 200 len: 345 microversion: 2.1 time: 0.190986 Apr 05 12:10:39.157559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 323/648] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:38 2021] GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:39.162869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:39.163781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:39.210336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.211448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.212505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.213195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.351971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:10:39.355091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ebc0314-6a02-4518-a1c8-225abbfddbb0',volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:10:39.600675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f4100614-5ccf-449b-bb3d-6185e81989e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.212280 Apr 05 12:10:39.629167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 326/649] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:10:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:10:39.641403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:39.652475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:39.671575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.672328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.673457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:39.674211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:39.875242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-be5b81de-8ec9-4d52-85ac-c4226da9db87 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.243893 Apr 05 12:10:39.876538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 327/650] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:39 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:39.886084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0a9c1088-d0f7-4172-a787-06c8159ef3e4 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Action: 'create', calling method: .version_select at 0x7f0100fa1f28>, body: {"snapshot": {"volume_id": "68cd5d0f-9869-4a54-b687-483322e7e3bc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-788097701"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:39.911371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:39.921850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-37990e37-5876-4a72-aaad-62531dea9a7a tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1513 microversion: 2.1 time: 0.762919 Apr 05 12:10:39.930246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 324/651] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:39 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1513 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:39.935310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e5b95b1e-3398-4c0c-8bda-4097ea6d2c1a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:39.938794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e5b95b1e-3398-4c0c-8bda-4097ea6d2c1a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:40.108176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5b95b1e-3398-4c0c-8bda-4097ea6d2c1a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:40.123630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e5b95b1e-3398-4c0c-8bda-4097ea6d2c1a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1092 microversion: 2.1 time: 0.192111 Apr 05 12:10:40.125081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 325/652] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:39 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1092 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:40.134821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:40.134821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:40.162559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:40.165423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:40.166377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:40.169404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:40.424463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0a9c1088-d0f7-4172-a787-06c8159ef3e4 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.546409 Apr 05 12:10:40.426562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 328/653] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Apr 5 12:10:39 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:40.431597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-cb347792-cc76-44ea-977c-86dae88b5bca req-650817fe-c53f-4b1e-aff2-e4dbb5cd3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:40.438870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:40.438870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:40.469878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cb347792-cc76-44ea-977c-86dae88b5bca req-650817fe-c53f-4b1e-aff2-e4dbb5cd3b5b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:40.470263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cb347792-cc76-44ea-977c-86dae88b5bca req-650817fe-c53f-4b1e-aff2-e4dbb5cd3b5b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:40.543358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-cb347792-cc76-44ea-977c-86dae88b5bca req-650817fe-c53f-4b1e-aff2-e4dbb5cd3b5b service nova] Creating event network-changed:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:10:40.562426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-cb347792-cc76-44ea-977c-86dae88b5bca req-650817fe-c53f-4b1e-aff2-e4dbb5cd3b5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134385 Apr 05 12:10:40.563133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 329/654] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:40.584905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-607e9ba3-46ea-4cc4-a2c3-1028a56ad5c4 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0101b6c158>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:40.683249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-607e9ba3-46ea-4cc4-a2c3-1028a56ad5c4 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.118805 Apr 05 12:10:40.684369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 330/655] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:40 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:40.697248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d46c1958-eba7-470a-a9eb-199995c7dc31 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0101b6c730>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:40.758770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d46c1958-eba7-470a-a9eb-199995c7dc31 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.068002 Apr 05 12:10:40.759721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 331/656] 10.222.0.36 () {58 vars in 1130 bytes} [Mon Apr 5 12:10:40 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:40.772559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e7e09a84-857d-414b-a90e-a3f5e454e819 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100fa1510>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:40.843834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e7e09a84-857d-414b-a90e-a3f5e454e819 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.076649 Apr 05 12:10:40.844944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 332/657] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:40 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:40.888918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:40.892427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:40.911660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:40.920420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:40.921663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:40.922371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.077133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9d0a0445-b8e7-478d-a247-debfb766d2db tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.192002 Apr 05 12:10:41.078850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 333/658] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:40 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:41.087399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-618b29a2-60f9-4e75-8ea8-f4fcfba82aae req-792f53b1-ba04-4c0c-9627-879027f63f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ee4b07-0251-47f5-aeb0-67863bdd6672", "name": "network-vif-deleted", "tag": "8982c272-f481-4303-82c5-1958c6301c19"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:41.089802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:41.089802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:41.104494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-618b29a2-60f9-4e75-8ea8-f4fcfba82aae req-792f53b1-ba04-4c0c-9627-879027f63f05 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:41.105758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-618b29a2-60f9-4e75-8ea8-f4fcfba82aae req-792f53b1-ba04-4c0c-9627-879027f63f05 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.128113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-618b29a2-60f9-4e75-8ea8-f4fcfba82aae req-792f53b1-ba04-4c0c-9627-879027f63f05 service nova] Creating event network-vif-deleted:8982c272-f481-4303-82c5-1958c6301c19 for instance 90ee4b07-0251-47f5-aeb0-67863bdd6672 on hv-cinder-78476 Apr 05 12:10:41.134453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-618b29a2-60f9-4e75-8ea8-f4fcfba82aae req-792f53b1-ba04-4c0c-9627-879027f63f05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 Apr 05 12:10:41.135337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 334/659] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:41.142757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:41.144526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:41.154457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:41.155259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.156712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:41.157416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.397062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:41.412106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:41.412823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:41.414645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:41.416133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-78711e1c-0cae-4a82-b2b5-d3ebbcd20f5d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 1.290059 Apr 05 12:10:41.416974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 326/660] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:40 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:41.430899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1e6e2af4-ef92-49d9-b04e-e06507b374b5 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1303 microversion: 2.1 time: 0.289800 Apr 05 12:10:41.431781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 335/661] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:41 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:41.435814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:41.436712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:41.445970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:41.446743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.448734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:41.449356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:41.693923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:41.716149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cf62850f-517e-433e-bfd4-672a2f296e78 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1190 microversion: 2.1 time: 0.285191 Apr 05 12:10:41.716938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 327/662] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:41 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1190 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:41.856959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b93b898-2bcf-475c-9572-295b4b85e61c tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0101b3a9d8>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:41.915766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b93b898-2bcf-475c-9572-295b4b85e61c tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.062829 Apr 05 12:10:41.916651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 336/663] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:41 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:42.090478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:42.091623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:42.113577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.114086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.114979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.115479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.437775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:42.438738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:42.450278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.450791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.452061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.452729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.681752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:42.695935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:42.697699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:42.698983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f6b56ba8-4379-47f3-a93a-f0cc7517b280 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.265900 Apr 05 12:10:42.700051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 337/664] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:42 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:42.704830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:42.705635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:42.742538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.743059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.743925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.744413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.863370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.863956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.864477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'fault' on Instance uuid 90ee4b07-0251-47f5-aeb0-67863bdd6672 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:42.935352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:42.944229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5bb5dfd3-f443-4e4d-9d29-4de5a67b60b4 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1308 microversion: 2.1 time: 0.243585 Apr 05 12:10:42.944859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 338/665] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:42 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:42.949598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-924878480"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:42.950198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:42.958370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.958875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:42.959712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:42.960197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:43.171697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.network.security_group_api [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Adding security group 91cc6402-4f33-4620-8607-9c8a92da671a to port cd022a21-f8f6-48a0-aafb-3a959f94237a Apr 05 12:10:43.884964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4eb1fc52-89ac-4216-ae3e-658e44333a72 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action" status: 202 len: 0 microversion: 2.1 time: 0.938993 Apr 05 12:10:43.886044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 339/666] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:42 2021] POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:10:43.893115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:43.894779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:43.917495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:43.934293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:43.935379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:43.935977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.067430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.076118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f4104a3b-13f0-4944-ab7a-102be2bec352 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1190 microversion: 2.1 time: 0.188230 Apr 05 12:10:44.076733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 340/667] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:43 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1190 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:44.081767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9085795a-3663-444e-a36d-5334d013267e tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100fa1a60>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:44.132453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9085795a-3663-444e-a36d-5334d013267e tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.054555 Apr 05 12:10:44.133036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 341/668] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:44 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:44.137631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:44.138421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:44.146528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.146985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.147813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.148297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.363124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.372314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.373983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.375213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1161a020-ef35-46ac-9866-bf937019a8f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.241192 Apr 05 12:10:44.375835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 342/669] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:44 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:44.381020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:44.381685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:44.389045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.389499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.390361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.390853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.601912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.611166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-77334e07-cb5d-4c3f-8819-d7be8be8eb81 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1640 microversion: 2.1 time: 0.234325 Apr 05 12:10:44.611783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 343/670] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:44 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1640 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:44.617171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-5b76ea2f-cac9-43c6-9f51-ed0a9cbbd78a req-7091ef33-01b3-4606-a63b-fb302a90d3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:44.618924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:44.618924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:44.627165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5b76ea2f-cac9-43c6-9f51-ed0a9cbbd78a req-7091ef33-01b3-4606-a63b-fb302a90d3a3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.627673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5b76ea2f-cac9-43c6-9f51-ed0a9cbbd78a req-7091ef33-01b3-4606-a63b-fb302a90d3a3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.645098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-5b76ea2f-cac9-43c6-9f51-ed0a9cbbd78a req-7091ef33-01b3-4606-a63b-fb302a90d3a3 service nova] Creating event network-changed:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:10:44.650405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-5b76ea2f-cac9-43c6-9f51-ed0a9cbbd78a req-7091ef33-01b3-4606-a63b-fb302a90d3a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Apr 05 12:10:44.651033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 344/671] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:44.656340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:44.657091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:44.664813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.665321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.666162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.666666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.740979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:44.741478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:44.741987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'fault' on Instance uuid 90ee4b07-0251-47f5-aeb0-67863bdd6672 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:44.806021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:44.814767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e9f5988-707b-42f3-9d86-10b069b588c9 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1308 microversion: 2.1 time: 0.162526 Apr 05 12:10:44.815494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 345/672] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:44 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:45.093080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:45.093756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:45.102469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.102978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.103824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.104318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.231112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:45.239907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6e7cdad4-a31e-4608-aafb-766736484cf6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1190 microversion: 2.1 time: 0.150930 Apr 05 12:10:45.240534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 346/673] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:45 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1190 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:45.245325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ef0452f-747e-405b-bdf0-db05ef874417 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100d98a60>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:45.295995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ef0452f-747e-405b-bdf0-db05ef874417 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.054362 Apr 05 12:10:45.296658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 347/674] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:45 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:45.395691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:45.396342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:45.404345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.404846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.405672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.406179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.466934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d6f1251b-9142-44ca-bd14-394eb6ceb921 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 3.380220 Apr 05 12:10:45.467641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 328/675] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:42 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 3382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:45.627998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:45.638074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:45.639811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:45.641040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-601fd214-e321-4937-9b7e-56380d4a3120 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.249939 Apr 05 12:10:45.641842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 348/676] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:45 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:10:45.834304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:45.835093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:45.843931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.844537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.845469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.846040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.946562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:45.946899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:45.947410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lazy-loading 'fault' on Instance uuid 90ee4b07-0251-47f5-aeb0-67863bdd6672 {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:10:46.031917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:46.045417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c0068299-04c3-494e-8ecc-55fdb20c9f0f tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 200 len: 1308 microversion: 2.1 time: 0.216379 Apr 05 12:10:46.046453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 329/677] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:45 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:46.257915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:46.259443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:46.268290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.268814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.270474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.270967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.309427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-787d8d6c-bff2-409d-a886-cf4b107775bc tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0102518598>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:46.393681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-787d8d6c-bff2-409d-a886-cf4b107775bc tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 287 microversion: 2.1 time: 0.088883 Apr 05 12:10:46.401104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 330/678] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:46 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:46.406459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-900eb8f8-74f1-4028-84a8-c102e3a239b8 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f010059c598>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:46.438157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:46.449860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c1af493-34b9-421c-a571-e28e485e4188 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1208 microversion: 2.1 time: 0.196626 Apr 05 12:10:46.450967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 349/679] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:46 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:46.481025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:46.492978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:46.511882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.512710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.513799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.514539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.620823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-900eb8f8-74f1-4028-84a8-c102e3a239b8 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 202 len: 0 microversion: 2.1 time: 0.218307 Apr 05 12:10:46.627005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 331/680] 10.222.0.36 () {58 vars in 1244 bytes} [Mon Apr 5 12:10:46 2021] DELETE /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:10:46.638190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d9eabe09-ec87-40d0-bb1e-369e61cc1513 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100849488>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:46.691894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d9eabe09-ec87-40d0-bb1e-369e61cc1513 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 200 len: 286 microversion: 2.1 time: 0.060524 Apr 05 12:10:46.696290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 332/681] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:46 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:46.697766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:46.698470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:46.707219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.707874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.708748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:46.709249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:46.933089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1945fee8-6a36-4d9f-bee3-5b743e66116b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.456909 Apr 05 12:10:46.933823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 350/682] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:46 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:47.064945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:47.066822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 90ee4b07-0251-47f5-aeb0-67863bdd6672] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:47.077636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:47.078260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:47.079077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:47.079568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:47.143031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Instance 90ee4b07-0251-47f5-aeb0-67863bdd6672 could not be found. Apr 05 12:10:47.143579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 404 to user: Instance 90ee4b07-0251-47f5-aeb0-67863bdd6672 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:47.145205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ad722a6a-6053-4aa4-ad3b-e040c2dc75bf tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672" status: 404 len: 111 microversion: 2.1 time: 0.084638 Apr 05 12:10:47.146189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 351/683] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:47 2021] GET /compute/v2.1/servers/90ee4b07-0251-47f5-aeb0-67863bdd6672 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:10:47.331474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:47.351784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:47.353532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:47.354840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d335c979-de96-444d-a5c8-b05114c21789 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1740 microversion: 2.20 time: 0.660870 Apr 05 12:10:47.355474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 333/684] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:46 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1740 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:47.470229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:47.471132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:47.491214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:47.491994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:47.493215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:47.495074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:47.705012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ffcd0e1-1234-46af-802f-050612369de2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0101aefd90>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:47.753232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-3ffcd0e1-1234-46af-802f-050612369de2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] HTTP exception thrown: Snapshot b06d7bb2-4c30-48f0-910a-4c657f403e1b could not be found. Apr 05 12:10:47.755036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ffcd0e1-1234-46af-802f-050612369de2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Returning 404 to user: Snapshot b06d7bb2-4c30-48f0-910a-4c657f403e1b could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:47.756342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3ffcd0e1-1234-46af-802f-050612369de2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b" status: 404 len: 111 microversion: 2.1 time: 0.055569 Apr 05 12:10:47.757148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 334/685] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:10:47 2021] GET /compute/v2.1/os-snapshots/b06d7bb2-4c30-48f0-910a-4c657f403e1b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:47.766225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-38b30e24-37f0-428d-835e-79647b4562e3 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100578840>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:47.885849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-38b30e24-37f0-428d-835e-79647b4562e3 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 202 len: 0 microversion: 2.1 time: 0.123759 Apr 05 12:10:47.886765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 335/686] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:10:47 2021] DELETE /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:10:47.898066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0dbc7408-3274-47c1-b337-89865dce18f0 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f01005798c8>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:48.005401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0dbc7408-3274-47c1-b337-89865dce18f0 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 200 len: 344 microversion: 2.1 time: 0.112553 Apr 05 12:10:48.006031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 336/687] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:47 2021] GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 344 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:48.011663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:48.013034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:48.022643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.023395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.024685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.025591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.076530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:48.095779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9354ef89-af42-49e4-a2fb-7d1b6f0e6547 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1275 microversion: 2.1 time: 0.630384 Apr 05 12:10:48.098568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 352/688] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:47 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1275 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:48.165662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e15dd406-54c4-45fe-9dcb-8ee8cdb7f977 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.157941 Apr 05 12:10:48.166908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 337/689] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:48 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:48.373199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:48.373872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:48.382698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.383204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.384042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.384531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.483741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:48.484510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:48.493986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.494536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.495381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.495875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.564204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:10:48.687066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d1fa61df-dc3a-435d-a70f-6a0e291d8130 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "DELETE /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 204 len: 0 microversion: 2.1 time: 0.208363 Apr 05 12:10:48.687941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 338/690] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:10:48 2021] DELETE /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:48.697301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:48.698081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:48.706066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.706664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.707543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:48.708065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:48.872033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:48.886484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:48.888680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:48.890140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7e551a19-6a33-417a-84f1-93e0c7c65927 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1722 microversion: 2.20 time: 0.521014 Apr 05 12:10:48.892022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 353/691] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:48 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:48.950504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:48.960863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f0c6f87e-9f41-4996-8dc6-105a80c60fa3 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1514 microversion: 2.1 time: 0.267993 Apr 05 12:10:48.961898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 339/692] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:48 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:49.019587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1468ead7-8709-4fcd-993b-b7f49c38ad7d tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100fa1b70>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.086293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-1468ead7-8709-4fcd-993b-b7f49c38ad7d tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] HTTP exception thrown: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. Apr 05 12:10:49.086963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1468ead7-8709-4fcd-993b-b7f49c38ad7d tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Returning 404 to user: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:49.087852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1468ead7-8709-4fcd-993b-b7f49c38ad7d tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 404 len: 109 microversion: 2.1 time: 0.072865 Apr 05 12:10:49.088465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 354/693] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:49 2021] GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:49.105420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a69e87ca-88cc-4c68-acdd-b03760f0f522 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0101aef730>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.114404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.115080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:49.136336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.136886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.137787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.138348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.179930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-a69e87ca-88cc-4c68-acdd-b03760f0f522 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] HTTP exception thrown: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. Apr 05 12:10:49.180844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a69e87ca-88cc-4c68-acdd-b03760f0f522 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Returning 404 to user: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:49.182402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a69e87ca-88cc-4c68-acdd-b03760f0f522 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 404 len: 109 microversion: 2.1 time: 0.080724 Apr 05 12:10:49.182402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 340/694] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:10:49 2021] DELETE /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:49.187851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:49.188994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:49.198529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.198987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.199854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.200355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.305824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2f00658f-9cea-4507-afc3-fe456b3a942f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.122008 Apr 05 12:10:49.306652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 341/695] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:49 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:49.312381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3a975f48-02a6-4d42-8d38-e28352f914c2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Calling method '.version_select at 0x7f0100578f28>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.389221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-3a975f48-02a6-4d42-8d38-e28352f914c2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] HTTP exception thrown: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. Apr 05 12:10:49.389938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3a975f48-02a6-4d42-8d38-e28352f914c2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] Returning 404 to user: Volume 68cd5d0f-9869-4a54-b687-483322e7e3bc could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:49.390874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3a975f48-02a6-4d42-8d38-e28352f914c2 tempest-VolumesSnapshotsTestJSON-1127727052 tempest-VolumesSnapshotsTestJSON-1127727052-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc" status: 404 len: 109 microversion: 2.1 time: 0.083065 Apr 05 12:10:49.391625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 342/696] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:49 2021] GET /compute/v2.1/os-volumes/68cd5d0f-9869-4a54-b687-483322e7e3bc => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:49.396741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-5c7bed53-6d4e-40b5-8674-00816d7a3c72 req-e295d603-246b-40ef-b181-6f6d3f216b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f627d1-6185-40fa-8a66-bf568242e6c1", "tag": "75dc0cbf-733b-4036-b284-69bfcafbac18"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:49.399477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:49.399477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:49.408914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5c7bed53-6d4e-40b5-8674-00816d7a3c72 req-e295d603-246b-40ef-b181-6f6d3f216b8a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.409423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5c7bed53-6d4e-40b5-8674-00816d7a3c72 req-e295d603-246b-40ef-b181-6f6d3f216b8a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.428001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-5c7bed53-6d4e-40b5-8674-00816d7a3c72 req-e295d603-246b-40ef-b181-6f6d3f216b8a service nova] Creating event network-changed:75dc0cbf-733b-4036-b284-69bfcafbac18 for instance 62f627d1-6185-40fa-8a66-bf568242e6c1 on hv-cinder-78476 Apr 05 12:10:49.433235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-5c7bed53-6d4e-40b5-8674-00816d7a3c72 req-e295d603-246b-40ef-b181-6f6d3f216b8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 Apr 05 12:10:49.433906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 343/697] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:49.476466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:49.486619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ccad9d12-4aa9-4a98-87a6-b02f2648e3dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.377110 Apr 05 12:10:49.506808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 355/698] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:49 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:49.913009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.913779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:49.922016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.922564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.923405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:49.923897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:49.980261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:49.981305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:50.000172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.001698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.005351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.005860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.210279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:50.232888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:50.234613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:50.235844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a1aec12-0725-4a9e-8888-936b67ab32a7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1722 microversion: 2.20 time: 0.328207 Apr 05 12:10:50.246348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 344/699] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:49 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:50.318250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:50.319285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:50.327160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.328639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.328639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.328977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.475549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:50.484941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d295dfa3-67a2-41af-a6a8-d01d646428a0 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1514 microversion: 2.1 time: 0.508753 Apr 05 12:10:50.491976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 356/700] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:49 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1514 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:50.509357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:50.510100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:50.517911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.518451 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.520219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:50.520733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:50.572437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b78b278-2df9-4933-b1aa-e60c295ba732 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.257897 Apr 05 12:10:50.576849 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 345/701] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:50 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:10:51.127996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:51.139342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9a38ad48-3c47-412a-9ed1-c1386efcb997 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.634324 Apr 05 12:10:51.140310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 357/702] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:50 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:51.259962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:51.261460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:51.276319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.277137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.278008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.278537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.504122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:51.505603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:51.518603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.523552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.528439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.529232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.656673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:51.670444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:51.672139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:51.673376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e3c6a9bd-6f7f-4ba8-9c6b-557ba562bad8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1665 microversion: 2.20 time: 0.419136 Apr 05 12:10:51.682777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 346/703] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:51 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1665 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:51.690478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:51.692711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:51.718738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.719620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.721138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.722692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.856882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1dcc49efc6f4a75aaf0573cb97591a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0184ae62e6427db9fd25988a10a9c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:51.870384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a36328bb-c462-4a59-9d05-386f93482416 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 200 len: 1514 microversion: 2.1 time: 0.371203 Apr 05 12:10:51.871427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 358/704] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:51 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:51.878582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60fe9565-50ea-4cb4-9cdf-414e44cd668b"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:51.880287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:51.885113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e1858b98-a6a5-4da4-895a-2fddb1112877 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.200829 Apr 05 12:10:51.886507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 347/705] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:51 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:51.890452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.891572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.892692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:51.893298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:51.991150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-0fea2c91-9e76-470b-922c-2d8ffbde0fed req-15f7073e-104e-4fad-aeec-373437bc6b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "name": "network-vif-unplugged", "status": "completed", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:51.992854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:51.992854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:52.014575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0fea2c91-9e76-470b-922c-2d8ffbde0fed req-15f7073e-104e-4fad-aeec-373437bc6b3f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.015087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0fea2c91-9e76-470b-922c-2d8ffbde0fed req-15f7073e-104e-4fad-aeec-373437bc6b3f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.059796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.compute.server_external_events [req-0fea2c91-9e76-470b-922c-2d8ffbde0fed req-15f7073e-104e-4fad-aeec-373437bc6b3f service nova] Unable to find a host for instance 41cc66fe-6283-4798-b54a-9647f39a77ad. Dropping event network-vif-unplugged {{(pid=98311) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 05 12:10:52.060764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-0fea2c91-9e76-470b-922c-2d8ffbde0fed req-15f7073e-104e-4fad-aeec-373437bc6b3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.076363 Apr 05 12:10:52.070493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 348/706] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 05 12:10:52.157755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:52.158947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:52.176532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.178562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.179441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.179943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.473805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:52.486409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a4fc9f3-f273-423e-9ce8-71059d6e27cb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.332991 Apr 05 12:10:52.489673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 349/707] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:52 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:52.499746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-480a8e82-9e97-4e31-8595-32bd05d33202 req-33c077e1-849c-41b4-b0f5-0a57cb72d3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a418d-96b3-4566-88fe-9f580c3f939d", "name": "network-vif-deleted", "tag": "57c15950-2ba5-4a42-bb4d-ae7ef56b0248"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:52.501732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:10:52.501732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:10:52.510964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-480a8e82-9e97-4e31-8595-32bd05d33202 req-33c077e1-849c-41b4-b0f5-0a57cb72d3e3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.511427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-480a8e82-9e97-4e31-8595-32bd05d33202 req-33c077e1-849c-41b4-b0f5-0a57cb72d3e3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.537641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-480a8e82-9e97-4e31-8595-32bd05d33202 req-33c077e1-849c-41b4-b0f5-0a57cb72d3e3 service nova] Creating event network-vif-deleted:57c15950-2ba5-4a42-bb4d-ae7ef56b0248 for instance 340a418d-96b3-4566-88fe-9f580c3f939d on hv-cinder-78476 Apr 05 12:10:52.542917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-480a8e82-9e97-4e31-8595-32bd05d33202 req-33c077e1-849c-41b4-b0f5-0a57cb72d3e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051833 Apr 05 12:10:52.543574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 350/708] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:52.563694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e5ddd5b0-5e20-4c1d-a405-b6dfd8c0a1d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.689917 Apr 05 12:10:52.564535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 359/709] 10.222.0.36 () {62 vars in 1354 bytes} [Mon Apr 5 12:10:51 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments => generated 188 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:52.685498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:52.686241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:52.694483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.694964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.696007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.696474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.889061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:52.889745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] [instance: 340a418d-96b3-4566-88fe-9f580c3f939d] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:52.896358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9076a85-eb94-4acd-8419-87ca7b296454 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action" status: 202 len: 0 microversion: 2.20 time: 0.215307 Apr 05 12:10:52.897449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 351/710] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:10:52 2021] POST /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:10:52.905409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:52.906584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:52.907269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.907785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.908641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.909140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.918990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.919860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.920907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:52.922220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:52.999388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] HTTP exception thrown: Instance 340a418d-96b3-4566-88fe-9f580c3f939d could not be found. Apr 05 12:10:53.000607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] Returning 404 to user: Instance 340a418d-96b3-4566-88fe-9f580c3f939d could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:10:53.001595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4f3f11c4-b481-443e-b79b-0fdafc3fae16 tempest-AttachVolumeNegativeTest-1632683347 tempest-AttachVolumeNegativeTest-1632683347-project] 10.222.0.36 "GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d" status: 404 len: 111 microversion: 2.1 time: 0.116849 Apr 05 12:10:53.002511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 360/711] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:52 2021] GET /compute/v2.1/servers/340a418d-96b3-4566-88fe-9f580c3f939d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:10:53.008337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:53.009135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:53.017059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:53.017593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:53.018503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:53.019046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:53.032395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9910ccb2-e97e-4d27-8d7e-e2ba90b6eb50 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.132887 Apr 05 12:10:53.036700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 352/712] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:52 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:53.491317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:53.502301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:53.504749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:53.506158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23f459b8-dd38-4343-84a3-d07433836f9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1751 microversion: 2.20 time: 0.502450 Apr 05 12:10:53.506948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 361/713] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:53 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1751 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:53.510050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:53.510934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:53.527904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:53.528390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:53.529259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:53.529760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:53.809299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:53.821290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-731fb127-eb21-4cc2-ae3e-6b858b67d7aa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.318202 Apr 05 12:10:53.827357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 353/714] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:53 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:10:54.045360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:54.046527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:54.060807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.061867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:54.063697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.064398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:54.186323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c5316e86-227b-492e-b4c8-c41c6b1b49f3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.144393 Apr 05 12:10:54.195520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 362/715] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:54 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:54.526236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:54.527407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:54.537332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.538746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:54.539834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.540478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:54.776263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:54.789341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:54.791050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:54.792443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-91184635-5456-4b7f-b2c5-97558087f1e0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1753 microversion: 2.20 time: 0.270404 Apr 05 12:10:54.793239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 354/716] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:54 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1753 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:54.841624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:54.842597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:54.852310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.853141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:54.854249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:54.855077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:55.136371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:55.153322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3eeb0531-ef94-428d-b718-1325a5abffca tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.318021 Apr 05 12:10:55.153970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 363/717] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:54 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:55.202659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:55.203708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:55.214352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:55.214870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:55.215724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:55.216228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:55.317538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e56c0a8d-622a-4f18-bbbe-320c0d4c1f1e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.118978 Apr 05 12:10:55.318993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 355/718] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:55 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:10:55.813111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:55.813782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:55.821767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:55.822306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:55.823396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:55.823887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:56.056754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:56.069594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:56.071837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:56.073297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4a37fb59-78d4-40ff-a043-ca5d656c4cdb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1753 microversion: 2.20 time: 0.264362 Apr 05 12:10:56.074067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 364/719] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:55 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:56.176081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:56.176856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:56.185288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:56.185793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:56.186670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:56.187157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:56.330573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:56.332658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:56.340542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:56.341150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:56.342094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:56.342934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:56.452109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a65ffa32-3fcd-4b9f-890c-310586362498 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 28628 microversion: 2.1 time: 0.126039 Apr 05 12:10:56.452816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 365/720] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:56 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 28628 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:10:56.454460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:56.464893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2bfb5496-5323-4ac5-9eeb-959137952204 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.296257 Apr 05 12:10:56.465697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 356/721] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:56 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:56.611252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-178fb27c-cb61-4ca4-9320-7b9c6240f2dc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Action: 'create', calling method: .version_select at 0x7f0100f2c488>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-216603589", "metadata": {"Type": "work"}}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:57.074933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-178fb27c-cb61-4ca4-9320-7b9c6240f2dc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.596120 Apr 05 12:10:57.075622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 366/722] 10.222.0.36 () {60 vars in 1146 bytes} [Mon Apr 5 12:10:56 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 598 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 05 12:10:57.088578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c0f3646b-54bc-4848-b8ac-13b81022be81 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f0100849f28>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:57.093133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:57.094045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:57.104066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.104660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.105678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.106373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.202957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c0f3646b-54bc-4848-b8ac-13b81022be81 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 200 len: 352 microversion: 2.1 time: 0.118883 Apr 05 12:10:57.203570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 357/723] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:57 2021] GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:57.371392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:57.383780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:57.385498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:57.386712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1eae859b-d250-4286-b194-76a62d6b420b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.297711 Apr 05 12:10:57.387333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 367/724] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:57 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:57.465135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:10:57.467614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:57.482756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.484604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.485697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.486605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:57.487580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.487772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:57.507438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.507952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.508809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:57.509303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:57.749466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:57.761024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b6ea913a-30c0-43ee-8c25-cafc853f478e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.279375 Apr 05 12:10:57.761869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 368/725] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:57 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:58.216832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4e5d4d0f-2222-4ef8-885a-f349450d5972 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f010102ad90>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:58.319716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4e5d4d0f-2222-4ef8-885a-f349450d5972 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 200 len: 353 microversion: 2.1 time: 0.106844 Apr 05 12:10:58.320357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 369/726] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:58 2021] GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:58.331643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-88124b1a-6de5-4e86-942f-a622bd688a06 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f0101a49e18>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:58.439898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-88124b1a-6de5-4e86-942f-a622bd688a06 tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 200 len: 353 microversion: 2.1 time: 0.111917 Apr 05 12:10:58.440596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 370/727] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:58 2021] GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:10:58.446586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:58.447542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:58.456894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:58.457525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:58.458524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:58.459026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:58.699728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:58.711777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:58.713703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:58.715228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-31cdbc91-386c-4703-80a7-c4c6c06448e5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.273085 Apr 05 12:10:58.716643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 371/728] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:58 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:10:58.723125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-df8efd0a-6c00-46f6-93f7-bc3089ec8eab tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f0101a49598>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:58.855730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-df8efd0a-6c00-46f6-93f7-bc3089ec8eab tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 202 len: 0 microversion: 2.1 time: 0.137728 Apr 05 12:10:58.859687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 372/729] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:10:58 2021] DELETE /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:10:58.865503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:58.866270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:58.875465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:58.875965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:58.876809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:58.877296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:59.099281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:59.119348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-89a08a29-6d52-4061-b87b-75f676419411 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.257978 Apr 05 12:10:59.119556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 373/730] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:10:58 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:10:59.133280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-546fdf7e-e7e8-4096-9400-07ccf4eb753b tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f0101a49598>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:59.237229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-546fdf7e-e7e8-4096-9400-07ccf4eb753b tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 200 len: 352 microversion: 2.1 time: 0.116585 Apr 05 12:10:59.238466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 374/731] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:10:59 2021] GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:10:59.740024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:10:59.741175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:10:59.752089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:59.752599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:59.753491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:10:59.753977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:10:59.984708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:59.996280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:59.997982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:10:59.999280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ecda342-462a-4b60-bd05-5e6f2e81a389 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.266091 Apr 05 12:10:59.999886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 375/732] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:10:59 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:00.137190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:00.137971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:00.146693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:00.147210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:00.148136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:00.148649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:00.410889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:00.434032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4310ec32-9b0d-4d37-976e-cf7e3bea4784 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.300759 Apr 05 12:11:00.434946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 376/733] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:00 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:00.439632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b15e3c87-e050-48c2-8f51-bfc668b99fdc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Calling method '.version_select at 0x7f0101a49840>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:00.516142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-b15e3c87-e050-48c2-8f51-bfc668b99fdc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] HTTP exception thrown: Volume 7659d01f-bac2-454e-85e5-b10ada704a14 could not be found. Apr 05 12:11:00.516812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b15e3c87-e050-48c2-8f51-bfc668b99fdc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] Returning 404 to user: Volume 7659d01f-bac2-454e-85e5-b10ada704a14 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:11:00.517795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b15e3c87-e050-48c2-8f51-bfc668b99fdc tempest-VolumesGetTestJSON-1423176826 tempest-VolumesGetTestJSON-1423176826-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14" status: 404 len: 109 microversion: 2.1 time: 0.082024 Apr 05 12:11:00.518561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 377/734] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:11:00 2021] GET /compute/v2.1/os-volumes/7659d01f-bac2-454e-85e5-b10ada704a14 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:11:01.020549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:01.021489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:01.031403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:01.031917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:01.032764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:01.033260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:01.336918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:01.347733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:01.349416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:01.350673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d2d24aa9-67ce-4e76-85da-64e268d834d2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.335972 Apr 05 12:11:01.351555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 378/735] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:01 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:11:01.452320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:01.453759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:01.480216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:01.480949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:01.482014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:01.483011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:01.918435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:01.927722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3b413a56-e78b-426e-af5e-a0cec292bea2 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.479133 Apr 05 12:11:01.928264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 379/736] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:01 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:01.945757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-a9ffa863-c835-41df-8911-4863b5eef3c9 req-47192453-3ea5-43d7-8a35-9a7f6e978a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f627d1-6185-40fa-8a66-bf568242e6c1", "name": "network-vif-plugged", "status": "completed", "tag": "75dc0cbf-733b-4036-b284-69bfcafbac18"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:01.950456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:11:01.950456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:11:01.968477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a9ffa863-c835-41df-8911-4863b5eef3c9 req-47192453-3ea5-43d7-8a35-9a7f6e978a5a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:01.968979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a9ffa863-c835-41df-8911-4863b5eef3c9 req-47192453-3ea5-43d7-8a35-9a7f6e978a5a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:01.995461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-a9ffa863-c835-41df-8911-4863b5eef3c9 req-47192453-3ea5-43d7-8a35-9a7f6e978a5a service nova] Creating event network-vif-plugged:75dc0cbf-733b-4036-b284-69bfcafbac18 for instance 62f627d1-6185-40fa-8a66-bf568242e6c1 on hv-cinder-78476 Apr 05 12:11:02.001046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-a9ffa863-c835-41df-8911-4863b5eef3c9 req-47192453-3ea5-43d7-8a35-9a7f6e978a5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071236 Apr 05 12:11:02.001715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 380/737] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:02.370837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:02.372010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:02.382444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:02.382963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:02.383831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:02.384329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:02.901521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:02.911803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:02.913677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:02.921162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc65d793-74fa-4bef-9af8-e93e76c1dcc2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.549534 Apr 05 12:11:02.932874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 381/738] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:02 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:02.946529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:02.947569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:02.957092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:02.957910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:02.958937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:02.959509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:03.205049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:03.217814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c08a8bd5-db4b-447b-bdf3-49f41e04143e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.275374 Apr 05 12:11:03.230614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 382/739] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:02 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:03.946274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:03.947635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:03.962037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:03.966044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:03.969511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:03.971656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:04.245724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:04.258073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:04.260565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:04.262293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c8901b06-c334-4bf2-b0f4-171f531e0ff6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.323052 Apr 05 12:11:04.263203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 383/740] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:03 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:04.274948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:04.278028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:04.295243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:04.295976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:04.296932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:04.297513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:04.682115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:04.692607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-13a3cb3b-fde9-4270-9faf-0d4cf7efd477 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.428044 Apr 05 12:11:04.701053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 384/741] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:04 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:05.289461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:05.290862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:05.304540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:05.305610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:05.307233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:05.308483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:05.611088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:05.622820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:05.624787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:05.626335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-337ca537-ec8c-4d60-b857-59851c7cc20c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.345575 Apr 05 12:11:05.630253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 385/742] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:05 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:11:05.718586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:05.719301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:05.736453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:05.737098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:05.738207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:05.738705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:06.140005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:06.149771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-09ca8132-6f7a-44a9-b892-77db0020dc7a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.434884 Apr 05 12:11:06.150672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 386/743] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:05 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:06.648303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:06.650157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:06.658071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:06.658862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:06.660145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:06.660788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:06.932221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:06.951212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:06.953322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:06.954606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c68d458e-e864-4f1d-9534-d5040667e097 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.311443 Apr 05 12:11:06.976145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 387/744] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:06 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:07.170820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:07.171736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:07.183825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:07.183825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:07.183825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:07.184178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:07.492296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:07.525635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a013e287-bac1-4814-a8f1-fdc36a514f84 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.359607 Apr 05 12:11:07.529530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 388/745] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:07 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:11:07.999487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:08.000197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:08.026441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:08.026872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:08.027719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:08.028191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:08.383102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:08.395022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:08.397089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:08.398687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cc4824ea-7eaa-4220-ac1a-00417ff45ec9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.403290 Apr 05 12:11:08.399724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 389/746] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:07 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:08.548500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:08.549300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:08.563766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:08.564372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:08.565294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:08.565833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:08.818077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:08.830624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-50fc515f-c958-4a25-a917-6bc9a738f9e0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.286452 Apr 05 12:11:08.843936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 390/747] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:08 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:09.421874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:09.422685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:09.438698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:09.439428 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:09.440440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:09.441748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:09.711490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:09.723497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:09.725550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:09.727029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9fddf52f-2001-4cb6-b6f2-b90ff0ed8bb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.310677 Apr 05 12:11:09.727623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 391/748] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:09 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:11:09.849471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:09.850164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:09.859159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:09.859665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:09.860502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:09.861123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:10.148260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:10.158086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0553bfed-a0fc-4d84-aa12-f1ac6db18d16 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.313140 Apr 05 12:11:10.158857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 392/749] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:09 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:10.747488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:10.749285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:10.760232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:10.760928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:10.761961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:10.762681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:11.021069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:11.031665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:11.033336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:11.034808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-94c2bc66-f0c6-4fc1-9d29-150024c5ed64 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.291157 Apr 05 12:11:11.035450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 393/750] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:10 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:11:11.176842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:11.177517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:11.185529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:11.186039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:11.186939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:11.187432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:11.644405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:11.653550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7bec37e3-f7b7-4326-b43f-1a556754dfa1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.480716 Apr 05 12:11:11.654195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 394/751] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:11 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:12.054805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:12.055567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:12.064223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:12.064927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:12.066583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:12.067304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:12.316573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:12.326811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:12.328611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:12.329888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-14b6d272-6298-4ab9-9eaf-5b13ce2b81be tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.279589 Apr 05 12:11:12.330529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 395/752] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:12 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:11:12.598928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ba1633a3-7d9c-42af-8304-0c455ae25665 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 38169 microversion: 2.1 time: 15.137602 Apr 05 12:11:12.603564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 358/753] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:10:57 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 38169 bytes in 15140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:11:12.672547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:12.673261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:12.682078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:12.682533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:12.683393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:12.683884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:12.908924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:12.918267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-50da30d4-e8c6-4d82-92b0-8544b5205708 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.249805 Apr 05 12:11:12.925566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 396/754] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:12 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:13.352484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:13.354176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:13.366648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.367444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.368801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.369784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.611664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:13.612876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:13.621331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.621837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.622707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.623193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.770220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-85f38283-9c9b-425e-b619-9edc02532186 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 200 len: 38291 microversion: 2.1 time: 0.162312 Apr 05 12:11:13.776213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 397/755] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:11:13 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 38291 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:11:13.782340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:13.782985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:13.792324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.792839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.793693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.794218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.855024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4c156682-4ad7-44c0-b875-bfee324c3a27 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/ips" status: 200 len: 146 microversion: 2.1 time: 0.077071 Apr 05 12:11:13.855836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 398/756] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:11:13 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/ips => generated 146 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:13.922452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:13.933262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:13.935231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:13.936646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eafcd5a4-fa09-479b-b955-cb93d49584d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.591294 Apr 05 12:11:13.937086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:13.937727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:13.938259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 359/757] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:13 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:13.946535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.947046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:13.947904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:13.948403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:14.278722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:14.288747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e605651e-88de-4f35-bf01-9694151618ee tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1263 microversion: 2.1 time: 0.355732 Apr 05 12:11:14.289373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 399/758] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:13 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1263 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:14.956337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:14.958108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:14.966936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:14.967726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:14.969186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:14.969873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:15.258298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:15.270369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:15.272221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:15.273438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-06d40e4f-7779-48be-be62-c3edd2b76047 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.321227 Apr 05 12:11:15.274874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 360/759] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:14 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:15.307750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:15.308783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:15.317302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:15.318258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:15.319429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:15.320104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:15.578316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:15.588343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7be440eb-2bed-4134-8710-fe72d4c5dc02 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1449 microversion: 2.1 time: 0.285357 Apr 05 12:11:15.589071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 400/760] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:15 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1449 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:15.606955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:15.607641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:15.615630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:15.616140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:15.616996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:15.617500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:15.844243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:15.853982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-417ce5dc-49d9-4e7f-ae2a-5fa8712321ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1449 microversion: 2.1 time: 0.250860 Apr 05 12:11:15.855046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 361/761] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:15 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1449 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:16.294081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:16.296347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:16.310942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:16.311801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:16.312886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:16.313514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:16.565265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c83a87fd-08a8-4137-9cd0-12dd36f3e827"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:16.566854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:16.575367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:16.576016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:16.576981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:16.577591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:16.647840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:16.663154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:16.664836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:16.666324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8a9f8e13-d9c3-404a-8f72-173f1463b020 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.376851 Apr 05 12:11:16.667117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 401/762] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:16 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:16.973366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d094793c-de79-4f87-a9f8-865313acb097 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412718 Apr 05 12:11:16.974740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 362/763] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:11:16 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:17.691240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:17.692429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:17.704787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:17.706605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:17.707614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:17.708324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:18.236817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:18.248611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:18.250514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:18.251917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-577f98d9-3f11-45da-b86b-8746eb341522 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.569051 Apr 05 12:11:18.253584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 402/764] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:17 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:19.275983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:19.278004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:19.290233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:19.291480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:19.292533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:19.293262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:19.546703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:19.558214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:19.559888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:19.561152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e5a66c72-382b-488a-91da-bc18ba706a11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.292502 Apr 05 12:11:19.561747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 363/765] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:19 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:20.258551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-25ffde91-1e9a-42fb-9a21-290158995633 req-cadad914-772b-4fb6-a7fc-f2e0a1436284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f627d1-6185-40fa-8a66-bf568242e6c1", "tag": "75dc0cbf-733b-4036-b284-69bfcafbac18"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:20.260692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:11:20.260692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:11:20.271747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-25ffde91-1e9a-42fb-9a21-290158995633 req-cadad914-772b-4fb6-a7fc-f2e0a1436284 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:20.272437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-25ffde91-1e9a-42fb-9a21-290158995633 req-cadad914-772b-4fb6-a7fc-f2e0a1436284 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:20.292276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-25ffde91-1e9a-42fb-9a21-290158995633 req-cadad914-772b-4fb6-a7fc-f2e0a1436284 service nova] Creating event network-changed:75dc0cbf-733b-4036-b284-69bfcafbac18 for instance 62f627d1-6185-40fa-8a66-bf568242e6c1 on hv-cinder-78476 Apr 05 12:11:20.299251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-25ffde91-1e9a-42fb-9a21-290158995633 req-cadad914-772b-4fb6-a7fc-f2e0a1436284 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044637 Apr 05 12:11:20.301302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 403/766] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:20.581802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:20.582895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:20.592318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:20.593249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:20.594218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:20.594933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:21.034036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:21.049669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:21.064660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:21.066750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e313eee1-7f80-484e-afa3-fe23dcad5436 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.489601 Apr 05 12:11:21.067519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 364/767] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:20 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:22.089529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:22.090329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:22.099296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:22.099806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:22.100647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:22.101132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:22.347910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:22.358012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:22.359948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:22.361171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b636732-8518-4c6b-8e98-620a5e12703a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.276519 Apr 05 12:11:22.361880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 404/768] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:22 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:23.381180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:23.381844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:23.390195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:23.390703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:23.391531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:23.392014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:23.605665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:23.616532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:23.618266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:23.619496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-229fbb07-5faf-4dd9-8f25-58d6905772da tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.242422 Apr 05 12:11:23.620102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 365/769] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:23 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:23.942559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-fbaa7d1a-2048-4c4a-991b-0f2b32a38d43 req-5ae041f7-f0fa-4692-b089-8b28d12b8fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "name": "network-vif-plugged", "status": "completed", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:23.944773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:11:23.944773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:11:23.961455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fbaa7d1a-2048-4c4a-991b-0f2b32a38d43 req-5ae041f7-f0fa-4692-b089-8b28d12b8fbc service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:23.972592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fbaa7d1a-2048-4c4a-991b-0f2b32a38d43 req-5ae041f7-f0fa-4692-b089-8b28d12b8fbc service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:23.993405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-fbaa7d1a-2048-4c4a-991b-0f2b32a38d43 req-5ae041f7-f0fa-4692-b089-8b28d12b8fbc service nova] Creating event network-vif-plugged:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:11:23.998904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-fbaa7d1a-2048-4c4a-991b-0f2b32a38d43 req-5ae041f7-f0fa-4692-b089-8b28d12b8fbc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062494 Apr 05 12:11:24.000203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 405/770] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:24.639046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:24.639436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:24.647564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:24.648087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:24.648936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:24.649681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:24.892340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:24.903584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:24.905653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:24.907029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-06da8d4c-37f7-4652-8c5e-bf2c6668e450 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.272748 Apr 05 12:11:24.907780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 366/771] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:24 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:25.015656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-59fe131d-7e7b-494e-b3fe-8bf30bd7c799 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:25.024952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59fe131d-7e7b-494e-b3fe-8bf30bd7c799 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:25.025722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-59fe131d-7e7b-494e-b3fe-8bf30bd7c799 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:25.087310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-59fe131d-7e7b-494e-b3fe-8bf30bd7c799 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Going to try to stop instance {{(pid=98312) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 05 12:11:25.188226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-59fe131d-7e7b-494e-b3fe-8bf30bd7c799 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 202 len: 0 microversion: 2.1 time: 0.176497 Apr 05 12:11:25.189167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 406/772] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:11:25 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:11:25.198016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:25.198727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:25.208834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:25.209350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:25.210257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:25.210946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:25.445818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:25.455257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0d114ff2-2013-4977-a4c9-57ae4f745c44 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.261847 Apr 05 12:11:25.456633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 367/773] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:25 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:25.930652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:25.932090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:25.943192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:25.944470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:25.945665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:25.946582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:26.225228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:26.236279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:26.238254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:26.239508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-baf8e1e4-f550-4b29-a1a6-492da769aff8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1809 microversion: 2.20 time: 0.315713 Apr 05 12:11:26.240106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 407/774] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:25 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:26.480314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:26.481350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:26.492696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:26.498178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:26.500266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:26.502724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:27.126895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:27.137905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fc086242-1a58-4234-a243-c18a9149c251 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.661633 Apr 05 12:11:27.139169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 368/775] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:26 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:27.260482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:27.261372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:27.272733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:27.273457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:27.273457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:27.282906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:27.534163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:27.545821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:27.547510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:27.548739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-390c31a5-5ef9-4301-92cb-9cd9c720da3b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1796 microversion: 2.20 time: 0.293268 Apr 05 12:11:27.549347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 408/776] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:11:27 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1796 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:11:28.157489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:28.158182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:28.166637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:28.167143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:28.167980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:28.168470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:28.391391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:28.401335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7a3687b6-495a-421c-a199-9e567af293a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.247885 Apr 05 12:11:28.401953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 369/777] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:28 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:28.989778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:11:28.990149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:11:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:11:29.420736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:29.421952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:29.430970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:29.431613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:29.432562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:29.433163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:29.669692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:29.679127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10755180-86f3-4a63-8e54-1dd173dfaa9f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.262635 Apr 05 12:11:29.679752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 409/778] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:29 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:30.699598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:30.700530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:30.708758 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:30.709421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:30.710503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:30.711088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:30.966967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:30.977526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e1c438b3-306c-40e4-8cb3-725ad2abea92 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.284120 Apr 05 12:11:30.978171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 370/779] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:30 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:31.995843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:31.996522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:32.005651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:32.006472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:32.007321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:32.007817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:32.235951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:32.245235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-85063f9e-4a81-4d00-be02-f8075d0a1471 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.253426 Apr 05 12:11:32.245904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 410/780] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:31 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:33.263667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:33.264335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:33.274328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:33.275448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:33.276407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:33.277294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:33.492744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:33.502988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ba94a278-06d1-4933-a4da-9789871cfb4e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.242598 Apr 05 12:11:33.503898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 371/781] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:33 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:34.521793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:34.522503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:34.530855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:34.531362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:34.532202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:34.532728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:34.751209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:34.760880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a630130c-32a5-46ab-8363-09ba524b5e12 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.243953 Apr 05 12:11:34.761512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 411/782] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:34 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:35.780994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:35.781784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:35.790646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:35.791154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:35.791990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:35.792622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:36.046624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:36.057359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-72ea0739-2ca8-46d8-9b07-5c4f88fb5acd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.281449 Apr 05 12:11:36.058343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 372/783] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:35 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:37.076376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:37.077045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:37.085420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:37.085930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:37.086809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:37.087299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:37.300670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:37.312296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-39897465-c89e-444c-82c6-f4b8c1d543f7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.239865 Apr 05 12:11:37.312923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 412/784] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:37 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:37.874429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1459029918", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "ce325ebd-7c26-4401-b685-6baabac43d9c"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:37.946861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] validate_networks() for [('ce325ebd-7c26-4401-b685-6baabac43d9c', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:11:38.331527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:38.332211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:38.340264 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:38.340778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:38.341633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:38.342173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:38.539434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:11:38.539909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:11:38.540445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:11:38.540900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:11:38.541354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:11:38.550444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:38.550984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:38.551910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:38.552409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:38.556116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:38.566361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8edd471c-fd7a-4c7f-89ea-af95eed2ff38 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.239282 Apr 05 12:11:38.567001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 413/785] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:38 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:38.571406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Getting quotas for project a4b830a10a514a4cb30105d6758c326e. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:11:38.575661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Getting quotas for user 04bd7499f6e34368a7b4f1106dfbdc88 and project a4b830a10a514a4cb30105d6758c326e. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:11:38.587553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:11:38.590162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:11:38.641785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-80a73882-fca1-4846-859e-41be7110e342 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771408 Apr 05 12:11:38.642513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 373/786] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:11:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:11:38.653938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4f97503c-c94f-4767-b22a-36a4d3ec3769 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:38.654629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4f97503c-c94f-4767-b22a-36a4d3ec3769 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:38.734069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4f97503c-c94f-4767-b22a-36a4d3ec3769 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:38.742238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4f97503c-c94f-4767-b22a-36a4d3ec3769 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1219 microversion: 2.1 time: 0.092493 Apr 05 12:11:38.743052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 414/787] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:38 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:39.585596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:39.586195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:39.594013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:39.594554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:39.595385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:39.595870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:39.760210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:39.760864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:39.770316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:39.770832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:39.771690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:39.772182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:39.810066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:39.821152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f73ee4f3-e939-450c-a49e-19204376c433 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1724 microversion: 2.1 time: 0.240468 Apr 05 12:11:39.821984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 374/788] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:39 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:39.901885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:39.911286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9c770122-f7a9-4d9b-b372-be98a9288741 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1271 microversion: 2.1 time: 0.155129 Apr 05 12:11:39.911909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 415/789] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:39 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:40.840353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:40.840958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:40.849918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:40.850535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:40.851532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:40.852179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:40.928996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:40.929677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:40.937594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:40.938109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:40.938985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:40.939482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:41.149311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:41.157483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:41.163695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-671a0f0d-3bac-4d12-9882-9725c43c0a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1701 microversion: 2.1 time: 0.327573 Apr 05 12:11:41.165311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 375/790] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:40 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1701 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:41.167732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c9f4f060-4fc1-433e-82f1-953bc34bbe54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.242624 Apr 05 12:11:41.168325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 416/791] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:40 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:41.182580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b2a8087-50bd-44d6-af9f-573d19c17661 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:41.190687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b2a8087-50bd-44d6-af9f-573d19c17661 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:41.191095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b2a8087-50bd-44d6-af9f-573d19c17661 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:41.252569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0b2a8087-50bd-44d6-af9f-573d19c17661 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Going to try to start instance {{(pid=98311) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 05 12:11:41.332702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b2a8087-50bd-44d6-af9f-573d19c17661 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 202 len: 0 microversion: 2.1 time: 0.153944 Apr 05 12:11:41.333753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 376/792] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:11:41 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:11:41.341962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:41.342729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:41.351943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:41.352586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:41.353438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:41.354092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:41.725866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:41.735473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8081224e-6645-455d-ab5e-94242f144072 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1710 microversion: 2.1 time: 0.397470 Apr 05 12:11:41.736108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 417/793] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:41 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1710 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:42.187195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:42.188351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:42.197219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:42.197991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:42.199114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:42.199687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:42.755245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:42.755888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:42.763708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:42.764098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:42.765035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:42.765525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:42.768737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:42.778978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1ab8aa8f-abd0-4151-aa27-e498e85879b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.596421 Apr 05 12:11:42.779948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 377/794] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:42 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:42.932368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-66acd38c-26ae-4314-80dd-4b93a84657ea req-fb27a332-8c79-483f-bc92-f0a491440576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e36c2ccd-44f1-4bdd-bd29-6b6870714f6e", "tag": "7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:42.934597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:11:42.934597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:11:42.943915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-66acd38c-26ae-4314-80dd-4b93a84657ea req-fb27a332-8c79-483f-bc92-f0a491440576 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:42.944420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-66acd38c-26ae-4314-80dd-4b93a84657ea req-fb27a332-8c79-483f-bc92-f0a491440576 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:42.963266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-66acd38c-26ae-4314-80dd-4b93a84657ea req-fb27a332-8c79-483f-bc92-f0a491440576 service nova] Creating event network-changed:7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb for instance e36c2ccd-44f1-4bdd-bd29-6b6870714f6e on hv-cinder-78476 Apr 05 12:11:42.969343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-66acd38c-26ae-4314-80dd-4b93a84657ea req-fb27a332-8c79-483f-bc92-f0a491440576 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180486 Apr 05 12:11:42.970549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 378/795] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:11:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:42.993460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:43.002868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b0a83c5a-a590-4fe8-b9eb-91b5c110b881 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1710 microversion: 2.1 time: 0.252239 Apr 05 12:11:43.003567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 418/796] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:42 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1710 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:43.798067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:43.798863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:43.806943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:43.807452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:43.808284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:43.808775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:44.021770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:44.022598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:44.030623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:44.031125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:44.031955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:44.032441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:44.273130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:44.282997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7a447f49-d70e-4f41-bda6-67ca7126cd57 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.489494 Apr 05 12:11:44.283663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 379/797] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:43 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:44.409652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:44.419076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-99fdea36-db04-4453-a5e2-0c8bfb1b4eaf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1714 microversion: 2.1 time: 0.401994 Apr 05 12:11:44.419698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 419/798] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:44 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1714 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:45.301336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:45.302006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:45.309827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:45.310387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:45.311215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:45.311699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:45.527038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:45.536545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7ed92605-9691-40f6-817a-6b2dcebbee32 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.239447 Apr 05 12:11:45.537165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 380/799] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:45 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:46.554467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:46.555142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:46.562965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:46.563471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:46.564300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:46.565280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:46.775320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:46.783949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b479d18-5ba4-4170-ba0f-6a4bc3b2585a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.233618 Apr 05 12:11:46.784635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 420/800] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:46 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:47.801975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:47.802681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:47.810426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:47.810941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:47.811779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:47.812271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:48.026344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:48.035811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6791e8ce-de61-4a59-968f-6f07527bcae0 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.237910 Apr 05 12:11:48.036440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 381/801] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:47 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:49.053577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:49.054270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:49.061980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:49.062517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:49.063342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:49.063827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:49.271080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:49.280045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e9cc92ea-634b-425f-84e7-a72618421033 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.231248 Apr 05 12:11:49.280657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 421/802] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:49 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:49.962363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-4b4908e1-8601-42f2-ad7b-34245ebae352 req-fec4533d-8179-4f50-b1d5-f9b3b7b3aa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36c2ccd-44f1-4bdd-bd29-6b6870714f6e", "name": "network-vif-plugged", "status": "completed", "tag": "7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:49.964155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:11:49.964155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:11:49.973465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-4b4908e1-8601-42f2-ad7b-34245ebae352 req-fec4533d-8179-4f50-b1d5-f9b3b7b3aa2c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:49.974007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-4b4908e1-8601-42f2-ad7b-34245ebae352 req-fec4533d-8179-4f50-b1d5-f9b3b7b3aa2c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:49.991519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-4b4908e1-8601-42f2-ad7b-34245ebae352 req-fec4533d-8179-4f50-b1d5-f9b3b7b3aa2c service nova] Creating event network-vif-plugged:7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb for instance e36c2ccd-44f1-4bdd-bd29-6b6870714f6e on hv-cinder-78476 Apr 05 12:11:49.996580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-4b4908e1-8601-42f2-ad7b-34245ebae352 req-fec4533d-8179-4f50-b1d5-f9b3b7b3aa2c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Apr 05 12:11:49.997276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 382/803] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:11:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:11:50.298181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:50.298879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:50.307373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:50.307876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:50.308700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:50.309192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:50.520125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:50.529200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a8871bd3-7301-400a-99ae-8dfe263386cb tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.235024 Apr 05 12:11:50.529817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 422/804] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:50 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:51.548684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:51.550329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:51.558254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:51.558766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:51.559605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:51.560099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:51.778297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:51.787711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7de8d916-3b67-4335-9372-bb3ec6b9b946 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1319 microversion: 2.1 time: 0.243556 Apr 05 12:11:51.788344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 383/805] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:51 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:52.805526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:52.806210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:52.814175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:52.814877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:52.815842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:52.816328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:53.025332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:53.034235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8a80e4b0-83a0-40d7-917f-b98eddc4af54 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1508 microversion: 2.1 time: 0.232687 Apr 05 12:11:53.034864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 423/806] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:52 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:55.939632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:11:55.941293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:55.949912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:55.950456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:55.951303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:55.951796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:56.100312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-39b13211-29e5-48a8-bb56-a355cf31583b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action" status: 202 len: 0 microversion: 2.1 time: 0.164598 Apr 05 12:11:56.101009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 384/807] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:11:55 2021] POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:11:56.111083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:56.111759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:56.125464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:56.125977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:56.126866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:56.127365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:56.348391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:56.357943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-404bbe01-96a9-408e-9bec-714614e543a6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1750 microversion: 2.1 time: 0.251710 Apr 05 12:11:56.358622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 424/808] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:56 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1750 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:57.377983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:57.378818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:57.387390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:57.387898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:57.388779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:57.389279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:57.627169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:57.637187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2e4674c3-3dfb-41e3-9638-6a9a9875fb42 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.263756 Apr 05 12:11:57.637816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 385/809] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:57 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:58.655947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:58.656624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:58.665267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:58.665777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:58.666676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:58.667169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:58.885880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:11:58.895771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7aa50148-36e2-440e-a5c2-c8516acfd7f2 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.243875 Apr 05 12:11:58.896386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 425/810] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:58 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:11:59.915119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:11:59.915795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:11:59.923703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:59.924224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:11:59.925885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:11:59.926391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:00.509307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:00.519457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6750441c-e718-473e-806d-7351ed334bb0 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.607707 Apr 05 12:12:00.520184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 386/811] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:11:59 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:01.537793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:01.538521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:01.546499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:01.547009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:01.547851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:01.548343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:01.764993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:01.775298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-100f889c-76da-4546-bcc9-008afaa14f2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.241905 Apr 05 12:12:01.775952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 426/812] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:01 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:02.794092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:02.794879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:02.803525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:02.804033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:02.804887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:02.805398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:03.017005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:03.026608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ff66a452-2f14-4e09-9fef-36b2902150d1 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.236461 Apr 05 12:12:03.027222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 387/813] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:02 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:04.045303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:04.046020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:04.054434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:04.054944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:04.055778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:04.056272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:04.271291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:04.281143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-66a7da0a-eb14-4feb-aaed-23012e61409c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.239837 Apr 05 12:12:04.281783 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 427/814] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:04 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:05.300294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:05.300970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:05.308670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:05.309167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:05.309987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:05.310494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:05.532516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:05.542090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e1f807eb-ecb7-4d45-b4c3-745f35d028f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.245881 Apr 05 12:12:05.542686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 388/815] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:05 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:06.561220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:06.561898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:06.570305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:06.570817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:06.571652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:06.572145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:06.799183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:06.808469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce9e54d5-8c96-4ced-a05f-25166cbf75d7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.251391 Apr 05 12:12:06.809102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 428/816] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:06 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:07.827462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:07.828818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:07.836603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:07.837111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:07.837945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:07.838483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:08.046646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:08.056209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-240d621b-2851-4dbd-aff6-e746cf7d3e16 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.232836 Apr 05 12:12:08.056831 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 389/817] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:07 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:09.075020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:09.075691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:09.084119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:09.084621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:09.085447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:09.085931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:09.295738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:09.305217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cc79ad51-86c1-4b99-b9ba-9773a55ede02 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.234254 Apr 05 12:12:09.305839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 429/818] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:09 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:10.323010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:10.323598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:10.332106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:10.332616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:10.333454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:10.333945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:10.550241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:10.559492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-baa0c1a8-21ae-4202-ba66-e81f522781b7 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.240707 Apr 05 12:12:10.560113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 390/819] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:10 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:11.578554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:11.579233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:11.587748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:11.588247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:11.589079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:11.589564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:11.806178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:11.816128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0baa5076-a01b-4954-afca-4c5ffa70f0df tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.241152 Apr 05 12:12:11.816744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 430/820] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:11 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:12.835058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:12.835748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:12.843483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:12.843984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:12.844807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:12.845291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:13.058072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:13.067862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3649b851-cd76-4603-b20a-8ffec99fd0ee tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1755 microversion: 2.1 time: 0.237497 Apr 05 12:12:13.068650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 391/821] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:12 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1755 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:14.086756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:14.087430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:14.095195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:14.095704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:14.096595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:14.097106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:14.314312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:14.324631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0e291e7d-f809-4430-82d0-9dd73dfaa33c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1758 microversion: 2.1 time: 0.241998 Apr 05 12:12:14.325231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 431/822] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:14 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:17.784566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba4596c3-3c9b-42c5-81ca-ad71bd563d42", "device": "/dev/sdb"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:12:17.786932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:17.794921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:17.796608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:17.797449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:17.797945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:18.177137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24102c8c-10f0-44df-b09c-5fce971b9e86 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "POST /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396433 Apr 05 12:12:18.177871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 392/823] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:12:17 2021] POST /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:12:46.076448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:46.077696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:46.086277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:46.086788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:46.087621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:46.088115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:46.262971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lazy-loading 'services' on Instance uuid e36c2ccd-44f1-4bdd-bd29-6b6870714f6e {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:12:46.402327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4d5a5e09-ea74-4d45-87ad-80019a1ec462 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e/os-volume_attachments/ba4596c3-3c9b-42c5-81ca-ad71bd563d42" status: 202 len: 0 microversion: 2.1 time: 0.329751 Apr 05 12:12:46.403041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 432/824] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:12:46 2021] DELETE /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e/os-volume_attachments/ba4596c3-3c9b-42c5-81ca-ad71bd563d42 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:12:47.617971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:47.618650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:47.627732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:47.628238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:47.629070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:47.629559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:47.693784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:12:47.806284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4e20c137-a96c-4e28-9641-0b1b525f4a47 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 204 len: 0 microversion: 2.1 time: 0.192994 Apr 05 12:12:47.806954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 393/825] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:12:47 2021] DELETE /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:12:47.817092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:47.817867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:47.825887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:47.826434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:47.827467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:47.828046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:48.036189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:48.044962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1b4b3f5e-d58d-4216-bcb7-0423795452be tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1514 microversion: 2.1 time: 0.233241 Apr 05 12:12:48.045591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 433/826] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:47 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:49.065723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:49.066582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:49.074359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:49.074863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:49.075687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:49.076175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:49.293142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:49.302863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-04b1ddec-ba9f-46a4-8456-12cac5d066b7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1514 microversion: 2.1 time: 0.242249 Apr 05 12:12:49.303488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 394/827] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:49 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:12:50.321100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:50.321772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:50.329694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:50.330249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:50.331083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:50.331573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:50.550083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:50.559481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-34a07c19-c6f5-4841-9932-c8924e3c07d3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 200 len: 1514 microversion: 2.1 time: 0.242398 Apr 05 12:12:50.570167 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 434/828] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:50 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:12:50.851782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-3bac2f8a-8806-474d-99f7-76b571faf29d req-954f85ff-8351-41e6-8841-3103f236649a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36c2ccd-44f1-4bdd-bd29-6b6870714f6e", "name": "network-vif-deleted", "tag": "7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:12:50.853640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:12:50.853640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:12:50.863676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-3bac2f8a-8806-474d-99f7-76b571faf29d req-954f85ff-8351-41e6-8841-3103f236649a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:50.864182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-3bac2f8a-8806-474d-99f7-76b571faf29d req-954f85ff-8351-41e6-8841-3103f236649a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:50.882037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-3bac2f8a-8806-474d-99f7-76b571faf29d req-954f85ff-8351-41e6-8841-3103f236649a service nova] Creating event network-vif-deleted:7d8bcf5f-c0bf-4d95-b6c4-33932c95bdcb for instance e36c2ccd-44f1-4bdd-bd29-6b6870714f6e on hv-cinder-78476 Apr 05 12:12:50.886998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-3bac2f8a-8806-474d-99f7-76b571faf29d req-954f85ff-8351-41e6-8841-3103f236649a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039321 Apr 05 12:12:50.887656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 395/829] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:12:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:12:51.148089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:12:51.148316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:12:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:12:51.578702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:51.579379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: e36c2ccd-44f1-4bdd-bd29-6b6870714f6e] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:51.587161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:51.587669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:51.588503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:51.589011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:51.640846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] HTTP exception thrown: Instance e36c2ccd-44f1-4bdd-bd29-6b6870714f6e could not be found. Apr 05 12:12:51.641495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Returning 404 to user: Instance e36c2ccd-44f1-4bdd-bd29-6b6870714f6e could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:12:51.642429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f087b71-39bb-4d2c-b3fb-fd5f335ea212 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e" status: 404 len: 111 microversion: 2.1 time: 0.068371 Apr 05 12:12:51.643020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 435/830] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:12:51 2021] GET /compute/v2.1/servers/e36c2ccd-44f1-4bdd-bd29-6b6870714f6e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:12:56.739006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:56.739697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:56.747722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:56.748177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:56.749004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:56.749500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:56.816191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8fe433a1-28b7-45ea-a845-80cbc9fea9f8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments/60fe9565-50ea-4cb4-9cdf-414e44cd668b" status: 200 len: 194 microversion: 2.20 time: 0.196098 Apr 05 12:12:56.816816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 396/831] 10.222.0.36 () {60 vars in 1444 bytes} [Mon Apr 5 12:12:56 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments/60fe9565-50ea-4cb4-9cdf-414e44cd668b => generated 194 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:12:56.929943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:56.930546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:56.938401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:56.938910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:56.939738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:56.940228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:57.109441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lazy-loading 'services' on Instance uuid 41cc66fe-6283-4798-b54a-9647f39a77ad {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:12:57.258369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4cc9160a-9bf2-4131-95cd-a2dd9a4836c1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments/60fe9565-50ea-4cb4-9cdf-414e44cd668b" status: 202 len: 0 microversion: 2.20 time: 0.332238 Apr 05 12:12:57.259019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 436/832] 10.222.0.36 () {60 vars in 1447 bytes} [Mon Apr 5 12:12:56 2021] DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad/os-volume_attachments/60fe9565-50ea-4cb4-9cdf-414e44cd668b => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:12:58.466359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:58.466907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:58.475068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:58.475566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:58.476388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:58.476875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:58.541719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:12:58.660989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce1db947-a1c9-47c6-afc9-ff594614af44 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 204 len: 0 microversion: 2.20 time: 0.198370 Apr 05 12:12:58.661778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 397/833] 10.222.0.36 () {60 vars in 1270 bytes} [Mon Apr 5 12:12:58 2021] DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:12:58.672076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:58.673109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:58.681360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:58.681867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:58.682756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:58.683270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:58.898946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:58.909036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:58.910821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:12:58.912027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-25588d8f-c978-4bb2-8499-23ac7fa43083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.245363 Apr 05 12:12:58.912640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 437/834] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:12:58 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:12:59.931989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:12:59.932756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:12:59.940718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:59.941224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:12:59.942047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:12:59.942577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:00.158171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:00.167477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:00.169137 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:00.170390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b3db07c8-b666-4cdf-b55f-d19e5851e774 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.242982 Apr 05 12:13:00.171008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 398/835] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:12:59 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:01.190074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:01.190799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:01.198633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:01.199131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:01.199953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:01.200440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:01.410227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:01.419549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:01.421212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:01.422432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-446e8108-a3ef-4518-a870-72477a1532e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.236592 Apr 05 12:13:01.423258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 438/836] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:01 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:02.442396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:02.442997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:02.451219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:02.451731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:02.452564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:02.453057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:02.673551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:02.682901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:02.684569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:02.685780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24dcc38b-b82f-4a03-8fa1-d4061b4ea553 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.247839 Apr 05 12:13:02.686427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 399/837] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:02 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:03.705095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:03.705755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:03.713667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:03.714244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:03.715067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:03.715549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:03.930283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:03.940116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:03.941790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:03.943055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-10cf8f20-3ac6-4905-a608-449657cb780d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.242196 Apr 05 12:13:03.943700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 439/838] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:03 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:04.011033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1814670476", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "networks": [{"uuid": "ce325ebd-7c26-4401-b685-6baabac43d9c"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:04.084095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] validate_networks() for [('ce325ebd-7c26-4401-b685-6baabac43d9c', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:13:04.962971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:04.963628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:04.971698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:04.972203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:04.973030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:04.973514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:05.201567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:05.211236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:05.212921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:05.214216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-794bf589-3a9f-488c-9acf-f464de6b24bc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1724 microversion: 2.20 time: 0.255289 Apr 05 12:13:05.214765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 440/839] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:04 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:05.403943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:13:05.404416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:13:05.404961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:13:05.405419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:13:05.405879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:13:05.415196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:05.415699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:05.416565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:05.417058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:05.439163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Getting quotas for project a4b830a10a514a4cb30105d6758c326e. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:13:05.443345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Getting quotas for user 04bd7499f6e34368a7b4f1106dfbdc88 and project a4b830a10a514a4cb30105d6758c326e. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:13:05.454276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:13:05.456864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:13:05.508677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eb5ff708-3c63-439a-a287-3ab18b9b952d tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501623 Apr 05 12:13:05.509485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 400/840] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:13:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:13:05.522416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d00a926d-5f33-4758-8eb8-cc498b1853fd tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:05.530761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d00a926d-5f33-4758-8eb8-cc498b1853fd tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:05.634344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d00a926d-5f33-4758-8eb8-cc498b1853fd tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:05.642965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d00a926d-5f33-4758-8eb8-cc498b1853fd tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1219 microversion: 2.1 time: 0.124575 Apr 05 12:13:05.643598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 441/841] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:05 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:06.189435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-7e08ce9b-014e-4ba2-ba8e-b59188fffb81 req-ff613931-377b-4a7f-a0b1-de629b937bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cc66fe-6283-4798-b54a-9647f39a77ad", "name": "network-vif-deleted", "tag": "7be1a319-4ced-48c7-93cc-a31f4f1d1bd8"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:06.201618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:06.201618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:06.212360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7e08ce9b-014e-4ba2-ba8e-b59188fffb81 req-ff613931-377b-4a7f-a0b1-de629b937bf3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:06.212871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-7e08ce9b-014e-4ba2-ba8e-b59188fffb81 req-ff613931-377b-4a7f-a0b1-de629b937bf3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:06.230101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-7e08ce9b-014e-4ba2-ba8e-b59188fffb81 req-ff613931-377b-4a7f-a0b1-de629b937bf3 service nova] Creating event network-vif-deleted:7be1a319-4ced-48c7-93cc-a31f4f1d1bd8 for instance 41cc66fe-6283-4798-b54a-9647f39a77ad on hv-cinder-78476 Apr 05 12:13:06.233484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:06.234631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:06.235585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-7e08ce9b-014e-4ba2-ba8e-b59188fffb81 req-ff613931-377b-4a7f-a0b1-de629b937bf3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051625 Apr 05 12:13:06.236788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 401/842] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:06.247138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:06.247717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:06.248554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:06.249314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:06.636413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:06.646893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:06.648796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:06.649993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2c4ad319-8784-41f5-9cf8-85764da7bf42 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 200 len: 1366 microversion: 2.20 time: 0.420891 Apr 05 12:13:06.651036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 442/843] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:06 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:06.666306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:06.667077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:06.676422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:06.676870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:06.677851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:06.678355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:06.803699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:06.812646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ca6f3d5a-e5c0-4239-bc27-e04d89e47c91 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1215 microversion: 2.1 time: 0.155288 Apr 05 12:13:06.824457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 402/844] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:06 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:07.671471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:07.672301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:07.681128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:07.681671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:07.682528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:07.683086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:07.744072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. Apr 05 12:13:07.744751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:13:07.745656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d24f2e0a-1fa2-4201-9cb5-8b7799534501 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 404 len: 111 microversion: 2.20 time: 0.078452 Apr 05 12:13:07.746343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 443/845] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:07 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:13:07.755830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fe5bd5aa-de97-4204-97f1-3bfc63c890f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '.version_select at 0x7f01006be598>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:07.779674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fe5bd5aa-de97-4204-97f1-3bfc63c890f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809058030" status: 204 len: 0 microversion: 2.20 time: 0.028525 Apr 05 12:13:07.784615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 403/846] 10.222.0.36 () {60 vars in 1249 bytes} [Mon Apr 5 12:13:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809058030 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:13:07.833414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:07.834504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:07.843653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:07.844441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:07.847522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:07.848195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:08.116722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:08.144101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-985ed651-328e-468f-890f-1550a546ab2e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1277 microversion: 2.1 time: 0.309944 Apr 05 12:13:08.154196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 444/847] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:07 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1277 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:09.164708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:09.165385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:09.174395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:09.174914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:09.175897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:09.176398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:09.204344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: .version_select at 0x7f0100ee5598>, body: {"keypair": {"name": "tempest-keypair-1412218617"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:09.228299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:13:09.232545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:13:09.430240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:13:09.434241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'key_pairs'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:13:09.448870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-252122b6-9338-4f63-8691-46bf42632166 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.248961 Apr 05 12:13:09.449727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 445/848] 10.222.0.36 () {62 vars in 1189 bytes} [Mon Apr 5 12:13:09 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 250 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:13:09.948225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:09.957674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-48115400-fd19-4dbc-a6d2-707258766559 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.796664 Apr 05 12:13:09.967582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 404/849] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:09 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:10.287794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-f878f968-d211-43aa-a84e-eff03bf34b77 req-43d9e464-02b8-431a-9c83-c92611328666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f871c675-3fa2-4f43-8915-d15a01dbe06f", "tag": "e5549816-d410-40ca-a56e-452bca2fc5c4"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:10.289592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:10.289592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:10.299727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f878f968-d211-43aa-a84e-eff03bf34b77 req-43d9e464-02b8-431a-9c83-c92611328666 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:10.300224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f878f968-d211-43aa-a84e-eff03bf34b77 req-43d9e464-02b8-431a-9c83-c92611328666 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:10.317806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-f878f968-d211-43aa-a84e-eff03bf34b77 req-43d9e464-02b8-431a-9c83-c92611328666 service nova] Creating event network-changed:e5549816-d410-40ca-a56e-452bca2fc5c4 for instance f871c675-3fa2-4f43-8915-d15a01dbe06f on hv-cinder-78476 Apr 05 12:13:10.322784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-f878f968-d211-43aa-a84e-eff03bf34b77 req-43d9e464-02b8-431a-9c83-c92611328666 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038947 Apr 05 12:13:10.323430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 446/850] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:10.975829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:10.976521 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:10.984587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:10.986223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:10.987092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:10.987593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:11.430016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:11.439414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-115c4857-6249-4850-b276-ba23a58bd04f tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.467735 Apr 05 12:13:11.440275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 405/851] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:10 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:11.512197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-862000895", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ba2dc6d-7a10-4983-bd4a-704d4ac9411b"}], "security_groups": [{"name": "tempest-securitygroup--1168197982"}], "key_name": "tempest-keypair-1412218617", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:11.652211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] validate_networks() for [('5ba2dc6d-7a10-4983-bd4a-704d4ac9411b', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:13:12.458788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:12.459484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:12.467761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:12.468276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:12.469143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:12.470184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:12.511433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:13:12.511911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:13:12.512492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:13:12.512951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:13:12.513415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:13:12.522838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:12.523344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:12.524210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:12.524699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:12.543587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for project 09a08590013048999464095fb2986698. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:13:12.547993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Getting quotas for user 614d6c5d4c9f483796cbd1bccbb4b3f9 and project 09a08590013048999464095fb2986698. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:13:12.559148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:13:12.561837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:13:12.615027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b25590c-5062-4f49-9684-7b15598af9e1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.107804 Apr 05 12:13:12.616031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 447/852] 10.222.0.36 () {62 vars in 1178 bytes} [Mon Apr 5 12:13:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 05 12:13:12.627074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:12.627753 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:12.687805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:12.696740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0f846eb3-f4d6-4f8e-a340-dc359f182957 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.243032 Apr 05 12:13:12.697568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 406/853] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:12 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:12.709853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:12.720090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:12.721879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:12.723045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d7786c8d-7d38-4050-851b-7074e3b89cd9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1281 microversion: 2.20 time: 0.100154 Apr 05 12:13:12.723644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 448/854] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:12 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:13:13.715389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:13.716671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:13.724812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:13.725303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:13.726160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:13.726663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:13.745812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:13.746923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:13.759052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:13.759918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:13.760891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:13.761483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:13.893886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:13.904533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:13.906245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:13.907737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d6ad9ede-e29e-42d7-be86-14d2c1733c55 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1351 microversion: 2.20 time: 0.166400 Apr 05 12:13:13.908913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 449/855] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:13 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1351 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:14.042237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:14.052088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1e0343d2-abff-424d-9f4a-461d4d6edae7 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.340612 Apr 05 12:13:14.052735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 407/856] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:13 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:14.927553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:14.928382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:14.936650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:14.937430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:14.938628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:14.939129 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:15.069326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:15.070426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:15.079286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:15.080108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:15.081221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:15.081930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:15.203192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:15.215953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:15.217759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:15.220235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-739a2c6a-5bad-4390-b822-c45b806f6587 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.295979 Apr 05 12:13:15.225001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 450/857] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:14 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:15.771615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:15.780712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c18b08dd-4ef8-4c67-aa8e-94e27f94b91a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.715477 Apr 05 12:13:15.781556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 408/858] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:15 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:16.246576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:16.247373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:16.256834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.258316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:16.259329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.259863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:16.494106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:16.505111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:16.512011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-dce4cfb4-2360-47a3-b7d0-2c30f12731e3 req-f13e3586-ce25-41fe-9de7-179c83e64520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f871c675-3fa2-4f43-8915-d15a01dbe06f", "name": "network-vif-plugged", "status": "completed", "tag": "e5549816-d410-40ca-a56e-452bca2fc5c4"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:16.513835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:16.513835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:16.521417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:16.522820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7227cac9-a2bd-456d-91a4-48e0a10a71af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.286634 Apr 05 12:13:16.523525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 451/859] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:16 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:16.535066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-dce4cfb4-2360-47a3-b7d0-2c30f12731e3 req-f13e3586-ce25-41fe-9de7-179c83e64520 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.535066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-dce4cfb4-2360-47a3-b7d0-2c30f12731e3 req-f13e3586-ce25-41fe-9de7-179c83e64520 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:16.551308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-dce4cfb4-2360-47a3-b7d0-2c30f12731e3 req-f13e3586-ce25-41fe-9de7-179c83e64520 service nova] Creating event network-vif-plugged:e5549816-d410-40ca-a56e-452bca2fc5c4 for instance f871c675-3fa2-4f43-8915-d15a01dbe06f on hv-cinder-78476 Apr 05 12:13:16.557648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-dce4cfb4-2360-47a3-b7d0-2c30f12731e3 req-f13e3586-ce25-41fe-9de7-179c83e64520 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111265 Apr 05 12:13:16.558465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 409/860] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:16.640645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-aa60e3d8-7baa-4bdb-afc2-1916733ab05c req-7cb25daa-3555-4bef-ae01-c770134c04e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:16.642996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:16.642996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:16.652296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-aa60e3d8-7baa-4bdb-afc2-1916733ab05c req-7cb25daa-3555-4bef-ae01-c770134c04e0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.652794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-aa60e3d8-7baa-4bdb-afc2-1916733ab05c req-7cb25daa-3555-4bef-ae01-c770134c04e0 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:16.671452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-aa60e3d8-7baa-4bdb-afc2-1916733ab05c req-7cb25daa-3555-4bef-ae01-c770134c04e0 service nova] Creating event network-changed:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:13:16.677722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-aa60e3d8-7baa-4bdb-afc2-1916733ab05c req-7cb25daa-3555-4bef-ae01-c770134c04e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041083 Apr 05 12:13:16.678661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 452/861] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:16.800387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:16.802039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:16.810957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.811683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:16.812539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:16.813205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:17.201121 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:17.210937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-871e9239-90b1-427a-94a6-0c023ea867e5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1319 microversion: 2.1 time: 0.416021 Apr 05 12:13:17.211681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 410/862] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:16 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:17.543700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:17.544505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:17.553217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:17.553726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:17.554593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:17.555090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:17.773202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:17.783855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:17.785566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:17.786759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2de5215b-4360-4c76-8982-e2283576cad3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.247691 Apr 05 12:13:17.787376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 453/863] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:17 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:18.229547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:18.230239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:18.238015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.238549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.239371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.239857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.452420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:18.461914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-68195a98-002a-4c39-9c55-8680472c1e58 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1508 microversion: 2.1 time: 0.236388 Apr 05 12:13:18.462556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 411/864] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:18 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:18.479858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49cbf542-5616-42d9-97f6-8ea12461bcfa", "device": "/dev/sdb"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:18.481570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:18.490014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.490566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.491405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.491896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.806099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:18.806963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:18.815999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.816514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.817426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:18.817924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:18.977891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-841c141a-9007-480a-855f-587b7d88f0c5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "POST /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501996 Apr 05 12:13:18.978522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 454/865] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:13:18 2021] POST /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:19.058183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:19.067765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:19.069450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:19.070651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c92c9013-f47f-44ac-bb77-bd5a84aba5e8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.268850 Apr 05 12:13:19.071380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 412/866] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:18 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:20.091024 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:20.091846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:20.100860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:20.101380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:20.102258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:20.102762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:20.317008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:20.326540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:20.328217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:20.329389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-baf17813-80da-45b1-b33f-493ba4bbff67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.243495 Apr 05 12:13:20.330003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 455/867] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:20 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:21.348580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:21.349256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:21.357865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:21.358427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:21.359297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:21.359816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:21.566498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:21.575851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:21.577527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:21.578717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6189eade-7ac7-4db0-9d94-c449347f9c03 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.234456 Apr 05 12:13:21.579378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 413/868] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:21 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:22.598462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:22.599128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:22.607295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:22.607802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:22.608624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:22.609110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:22.825305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:22.835459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:22.837144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:22.838344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23580253-bd9d-4865-84f2-a613e743ceb4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.244613 Apr 05 12:13:22.838967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 456/869] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:22 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:23.857349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:23.858038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:23.866200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:23.866718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:23.867560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:23.868066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:24.079991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:24.089362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:24.091070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:24.092236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-713ee4f3-8263-4048-8c7d-dc286bc3fd11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.239074 Apr 05 12:13:24.092855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 414/870] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:23 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:24.469751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-6286dc95-ab87-401b-bb3f-ed41012f5c36 req-3b93c3f9-667b-4466-98cb-c52fd71588e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "name": "network-vif-plugged", "status": "completed", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:24.471790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:24.471790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:24.480596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-6286dc95-ab87-401b-bb3f-ed41012f5c36 req-3b93c3f9-667b-4466-98cb-c52fd71588e9 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:24.481072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-6286dc95-ab87-401b-bb3f-ed41012f5c36 req-3b93c3f9-667b-4466-98cb-c52fd71588e9 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:24.498299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-6286dc95-ab87-401b-bb3f-ed41012f5c36 req-3b93c3f9-667b-4466-98cb-c52fd71588e9 service nova] Creating event network-vif-plugged:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:13:24.504036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-6286dc95-ab87-401b-bb3f-ed41012f5c36 req-3b93c3f9-667b-4466-98cb-c52fd71588e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Apr 05 12:13:24.504764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 457/871] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:25.113284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:25.114064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:25.122141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:25.122698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:25.123578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:25.124064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:25.335227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:25.344597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:25.346434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:25.347598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-529068cc-3dad-48f0-b9b8-791271880402 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1407 microversion: 2.20 time: 0.239311 Apr 05 12:13:25.348211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 415/872] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:25 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:26.367703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:26.368473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:26.376985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:26.377493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:26.378352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:26.378847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:26.591079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:26.600374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:26.602044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:26.603274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8239e16b-4c8e-4193-92df-41fe97a190fe tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1600 microversion: 2.20 time: 0.240135 Apr 05 12:13:26.603894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 458/873] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:13:26 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1600 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:13:26.621866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:26.622379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:26.630992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:26.631499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:26.632332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:26.632821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:26.798432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7da0600b-d355-4f93-bcf0-285ab3b806e9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180054 Apr 05 12:13:26.799075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 416/874] 10.222.0.36 () {60 vars in 1306 bytes} [Mon Apr 5 12:13:26 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:13:28.554099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:28.555158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:28.569907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:28.570441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:28.571396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:28.571882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:28.623048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-189d6da0-7fe2-49a0-8dae-3a8a6e4616bf req-5df1feb6-9f00-48b2-8271-6ea5fe8d3e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:28.625113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:28.625113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:28.634600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-189d6da0-7fe2-49a0-8dae-3a8a6e4616bf req-5df1feb6-9f00-48b2-8271-6ea5fe8d3e98 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:28.635307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-189d6da0-7fe2-49a0-8dae-3a8a6e4616bf req-5df1feb6-9f00-48b2-8271-6ea5fe8d3e98 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:28.654088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-189d6da0-7fe2-49a0-8dae-3a8a6e4616bf req-5df1feb6-9f00-48b2-8271-6ea5fe8d3e98 service nova] Creating event network-changed:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:13:28.659806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-189d6da0-7fe2-49a0-8dae-3a8a6e4616bf req-5df1feb6-9f00-48b2-8271-6ea5fe8d3e98 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100247 Apr 05 12:13:28.660474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 417/875] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:32.024644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6da4d28f-fac4-4675-bdb5-7e204805858c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 14 microversion: 2.20 time: 3.474483 Apr 05 12:13:32.028469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 459/876] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:28 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 14 bytes in 3476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:32.318496 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:32.319152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:32.327749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:32.328243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:32.329101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:32.329595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:32.538640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lazy-loading 'services' on Instance uuid a65c1062-5d66-496a-ae26-06d7d61b2fed {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:13:32.711909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1579db3e-afdf-4ee4-b79b-9449922b99bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-volume_attachments/c83a87fd-08a8-4137-9cd0-12dd36f3e827" status: 202 len: 0 microversion: 2.1 time: 0.530979 Apr 05 12:13:32.712691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 418/877] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:13:32 2021] DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/os-volume_attachments/c83a87fd-08a8-4137-9cd0-12dd36f3e827 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:33.038510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:33.039829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:33.051683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:33.052117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:33.052969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:33.053447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:33.188744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-260c19ca-e9d1-485e-a276-9b37cffe48d9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 14 microversion: 2.20 time: 0.155339 Apr 05 12:13:33.192822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 460/878] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:33 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:33.956845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-47a31b40-1d10-4c61-b609-5b09c13ecaff tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:33.964987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47a31b40-1d10-4c61-b609-5b09c13ecaff tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:33.965492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47a31b40-1d10-4c61-b609-5b09c13ecaff tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:34.023761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-47a31b40-1d10-4c61-b609-5b09c13ecaff tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Going to try to stop instance {{(pid=98311) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 05 12:13:34.100131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-47a31b40-1d10-4c61-b609-5b09c13ecaff tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 202 len: 0 microversion: 2.1 time: 0.147648 Apr 05 12:13:34.100777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 419/879] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:13:33 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:13:34.111358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:34.112697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:34.121834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:34.122687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:34.123553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:34.124048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:34.201693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:34.202914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:34.211528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:34.212039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:34.212870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:34.213353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:34.333804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:34.342595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ba6c4579-1718-4ce9-a424-e2112385e862 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.236963 Apr 05 12:13:34.343221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 461/880] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:34 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:35.361355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:35.362249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:35.370558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:35.371065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:35.371894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:35.372422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:35.582672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:35.591469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-52829b21-6b21-4152-8eb8-e102be6bc88a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.234328 Apr 05 12:13:35.592088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 462/881] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:35 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:36.610894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:36.611593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:36.620148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:36.620650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:36.621469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:36.621952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:36.832058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:36.842771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1e2048be-6ece-4b12-91e7-3a651d39c535 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.235895 Apr 05 12:13:36.843564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 463/882] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:36 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:37.861897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:37.862622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:37.870946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:37.871454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:37.872286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:37.872777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:37.898279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-15ba18dc-f5bc-4644-94e4-a03e42ca96af tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 14 microversion: 2.20 time: 3.700850 Apr 05 12:13:37.901926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 420/883] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:34 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 14 bytes in 3703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:38.087203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:38.095964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5c2ec3aa-3e6d-4db0-a41a-eea957124728 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.238322 Apr 05 12:13:38.096882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 464/884] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:37 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:38.911394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:38.912651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:38.921191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:38.921699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:38.922563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:38.923054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:39.024078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28af4c61-8c1a-46be-aaff-9817c8a575b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 14 microversion: 2.20 time: 0.117963 Apr 05 12:13:39.024748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 421/885] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:38 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:39.114996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:39.115596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:39.123394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:39.123901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:39.124738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:39.125237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:39.337344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:39.346320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dae01da1-cbed-462e-9225-f80f2f78a486 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.235872 Apr 05 12:13:39.346952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 465/886] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:39 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:40.037072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:40.038220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:40.046659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:40.047198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:40.048029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:40.048514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:40.149876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-918964e7-90da-4b9b-aa7d-68d22a2ccc98 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 14 microversion: 2.20 time: 0.117656 Apr 05 12:13:40.153654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 422/887] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:40 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:40.364807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:40.365419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:40.373140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:40.373646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:40.374516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:40.374980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:40.585786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:40.594525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d193fd5-cae4-4218-8f3f-4763acc715a0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.234032 Apr 05 12:13:40.595147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 466/888] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:40 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:41.162418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:41.163567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:41.172215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:41.172728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:41.173580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:41.174076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:41.279333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f7fbd2b-63ba-40fa-b751-22d099d2b50f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 10893 microversion: 2.20 time: 0.121677 Apr 05 12:13:41.280043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 423/889] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:41 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 10893 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:41.614111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:41.614807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:41.622588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:41.623092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:41.623919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:41.624407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:41.840696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:41.850337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b112d03f-e4e4-4669-b5fd-aac3e63020bd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.240959 Apr 05 12:13:41.850965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 467/890] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:41 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:42.291735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:42.292880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:42.301492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.302003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:42.302865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.303358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:42.374761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:42.375433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:42.384385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.384902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:42.385735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.386252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:42.422816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d038c7a8-284e-4b3c-915a-3fab1c3a436f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 16721 microversion: 2.20 time: 0.135270 Apr 05 12:13:42.423651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 424/891] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:42 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 16721 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:42.560669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lazy-loading 'services' on Instance uuid f871c675-3fa2-4f43-8915-d15a01dbe06f {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:13:42.703169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-63ac795e-676a-4212-ac61-23fce05d8ca2 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f/os-volume_attachments/49cbf542-5616-42d9-97f6-8ea12461bcfa" status: 202 len: 0 microversion: 2.1 time: 0.332457 Apr 05 12:13:42.703796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 468/892] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:13:42 2021] DELETE /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f/os-volume_attachments/49cbf542-5616-42d9-97f6-8ea12461bcfa => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:13:42.869937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:42.870741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:42.879374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.879889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:42.880725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:42.881214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:43.090495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:43.099832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-65512042-5e85-47ca-b69e-ca08d09fe6e2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.234347 Apr 05 12:13:43.100456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 425/893] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:42 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:43.435786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:43.437046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:43.446258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:43.446803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:43.447630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:43.448177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:43.547669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f7df4406-e882-45b6-b42f-e2f02258d0f2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 18083 microversion: 2.20 time: 0.116343 Apr 05 12:13:43.548336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 469/894] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:43 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 18083 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:43.913055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:43.913608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:43.921899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:43.922436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:43.923258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:43.923742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:43.987408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:13:44.100133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-be8277fd-1e63-4e21-bae1-2b3149ac879e tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 204 len: 0 microversion: 2.1 time: 0.190805 Apr 05 12:13:44.100776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 426/895] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:13:43 2021] DELETE /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:13:44.113804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:44.114832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:44.119801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:44.120586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:44.123896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.124399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.125445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.125932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.129724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.130275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.131160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.131652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.337827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:44.345973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:44.347755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24f78c19-ae79-4840-b46a-a48f155baf0a tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1514 microversion: 2.1 time: 0.239841 Apr 05 12:13:44.348452 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 470/896] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:44 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:44.355494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8bc7fbb-bfde-4455-86c4-1b0e3d24f3b1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.240691 Apr 05 12:13:44.356110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 427/897] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:44 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:44.560366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:44.561333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:44.569297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.569798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.570643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:44.571132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:44.668404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-674cae45-1600-4d9d-9b13-dcd1624e3eb6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 20173 microversion: 2.20 time: 0.112014 Apr 05 12:13:44.669075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 471/898] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:44 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 20173 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:45.366459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:45.367183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:45.374324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:45.375099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:45.375230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.375634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.376470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.376960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.384059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.384563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.385397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.385883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.592499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:45.601949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ad22f0e3-a89b-4172-88cf-a035f01c7455 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1514 microversion: 2.1 time: 0.239636 Apr 05 12:13:45.602623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 428/899] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:45 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:45.603923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:45.613321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e668cc0f-e758-4374-b418-c6a8b9731fe2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.243363 Apr 05 12:13:45.613930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 472/900] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:45 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:45.680277 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:45.681416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:45.689286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.689995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.691319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:45.691319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:45.789606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28381857-7349-4248-97ec-06e5fabb8b32 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 22113 microversion: 2.20 time: 0.113041 Apr 05 12:13:45.790262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 429/901] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:45 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 22113 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:46.027421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-924878480"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:46.028214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:46.036475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.036987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:46.037816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.038357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:46.245070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.network.security_group_api [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Removing security group 91cc6402-4f33-4620-8607-9c8a92da671a from port cd022a21-f8f6-48a0-aafb-3a959f94237a Apr 05 12:13:46.621618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:46.622488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:46.632233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.632764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:46.633653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.634163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:46.970074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d653bc5f-f057-436f-bbd1-dbe481387763 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action" status: 202 len: 0 microversion: 2.1 time: 0.947067 Apr 05 12:13:46.971266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 473/902] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:13:46 2021] POST /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:46.978110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:46.979061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:46.989649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.990954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:46.991915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:46.992486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.089060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:47.098887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-edacf4a6-e40e-49fc-988d-440dd1fd772b tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1514 microversion: 2.1 time: 0.481960 Apr 05 12:13:47.099539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 430/903] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:46 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1514 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:47.104309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:47.104861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:47.113312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.113824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.114703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.115199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.190950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:13:47.377813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fe4f25d1-915d-45e7-b008-36e37fe3f461 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 204 len: 0 microversion: 2.1 time: 0.276329 Apr 05 12:13:47.378665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 431/904] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:13:47 2021] DELETE /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:13:47.384629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:47.386105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:47.398487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.399680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.401558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.403328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.437648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:47.449704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3715e3ef-4d28-49e9-84a6-b93658abe8a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1678 microversion: 2.1 time: 0.476719 Apr 05 12:13:47.450596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 474/905] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:46 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1678 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:47.455880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-59612f89-dcb8-4e89-8f32-351ab5275dd7 req-5b4812bd-e7ca-4c68-8250-f96ac391d71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:47.458510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:47.458510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:47.468378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-59612f89-dcb8-4e89-8f32-351ab5275dd7 req-5b4812bd-e7ca-4c68-8250-f96ac391d71c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.469089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-59612f89-dcb8-4e89-8f32-351ab5275dd7 req-5b4812bd-e7ca-4c68-8250-f96ac391d71c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.489076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-59612f89-dcb8-4e89-8f32-351ab5275dd7 req-5b4812bd-e7ca-4c68-8250-f96ac391d71c service nova] Creating event network-changed:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:13:47.494504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-59612f89-dcb8-4e89-8f32-351ab5275dd7 req-5b4812bd-e7ca-4c68-8250-f96ac391d71c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042440 Apr 05 12:13:47.495343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 475/906] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:47.503650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:47.504418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:47.512793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.513295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.514170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.514819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.523990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4218eb58-9a25-4406-9cbf-ad6869e5b083 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 24524 microversion: 2.20 time: 0.143676 Apr 05 12:13:47.529916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 432/907] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:47 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 24524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:47.908395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-b063aeb5-e59e-4c6a-9a49-3cccaebc3e3d req-072f251b-1401-4145-81fd-0a90ccf4b49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f871c675-3fa2-4f43-8915-d15a01dbe06f", "name": "network-vif-deleted", "tag": "e5549816-d410-40ca-a56e-452bca2fc5c4"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:47.911806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:47.911806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:47.922408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-b063aeb5-e59e-4c6a-9a49-3cccaebc3e3d req-072f251b-1401-4145-81fd-0a90ccf4b49b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:47.923656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-b063aeb5-e59e-4c6a-9a49-3cccaebc3e3d req-072f251b-1401-4145-81fd-0a90ccf4b49b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:47.944291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-b063aeb5-e59e-4c6a-9a49-3cccaebc3e3d req-072f251b-1401-4145-81fd-0a90ccf4b49b service nova] Creating event network-vif-deleted:e5549816-d410-40ca-a56e-452bca2fc5c4 for instance f871c675-3fa2-4f43-8915-d15a01dbe06f on hv-cinder-78476 Apr 05 12:13:47.949473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-b063aeb5-e59e-4c6a-9a49-3cccaebc3e3d req-072f251b-1401-4145-81fd-0a90ccf4b49b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046363 Apr 05 12:13:47.950542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 433/908] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:13:47.962517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:47.971878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ce031735-460f-4b7d-85d2-c0b33c36a974 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1574 microversion: 2.1 time: 0.472609 Apr 05 12:13:47.972526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 476/909] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:47 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1574 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.118485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:48.119270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:48.131304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.131854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.133388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.134008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.229995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.230537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.231043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lazy-loading 'fault' on Instance uuid f871c675-3fa2-4f43-8915-d15a01dbe06f {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:13:48.347754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bd7499f6e34368a7b4f1106dfbdc88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4b830a10a514a4cb30105d6758c326e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:48.375637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-288feeaa-e65c-4c7a-bb46-9b314d2968f5 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 200 len: 1309 microversion: 2.1 time: 0.262047 Apr 05 12:13:48.376298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 434/910] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:48 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.469903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:48.471590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:48.488042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.489195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.490657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.491468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.539138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:48.540936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:48.550080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.550749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.551611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.552107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.717058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:48.726513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-30951283-d3ac-4f54-b733-bac532620d58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 26008 microversion: 2.20 time: 0.193077 Apr 05 12:13:48.726724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1aa68443-c2e8-4c6e-9255-1e41507b0594 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1655 microversion: 2.1 time: 0.262225 Apr 05 12:13:48.728123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 435/911] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:48 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 26008 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:48.728243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 477/912] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:48 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1655 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:48.746055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-084e2e6b-0c5c-41ad-a4bc-3460978eeccc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:48.754816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-084e2e6b-0c5c-41ad-a4bc-3460978eeccc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.755410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-084e2e6b-0c5c-41ad-a4bc-3460978eeccc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.823493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-084e2e6b-0c5c-41ad-a4bc-3460978eeccc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Going to try to start instance {{(pid=98311) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 05 12:13:48.906648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-084e2e6b-0c5c-41ad-a4bc-3460978eeccc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action" status: 202 len: 0 microversion: 2.1 time: 0.165641 Apr 05 12:13:48.907317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 436/913] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:13:48 2021] POST /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:48.916560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:48.917456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:48.926481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.927085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.928182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:48.928782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:48.993873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:48.994911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:49.020905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.021581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.022641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.023201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.488338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:49.499048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7098d833-be0d-4c7e-8d71-d36960a0496e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1664 microversion: 2.1 time: 0.586613 Apr 05 12:13:49.500114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 478/914] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:48 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1664 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:49.506393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:49.507327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] [instance: f871c675-3fa2-4f43-8915-d15a01dbe06f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:49.515311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.515945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.516892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.517489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.573204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] HTTP exception thrown: Instance f871c675-3fa2-4f43-8915-d15a01dbe06f could not be found. Apr 05 12:13:49.574030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] Returning 404 to user: Instance f871c675-3fa2-4f43-8915-d15a01dbe06f could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:13:49.575072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cee115b7-6757-417f-9e36-0bb4b4540bf3 tempest-VolumesSnapshotTestJSON-1296437904 tempest-VolumesSnapshotTestJSON-1296437904-project] 10.222.0.36 "GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f" status: 404 len: 111 microversion: 2.1 time: 0.073651 Apr 05 12:13:49.575770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 479/915] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:49 2021] GET /compute/v2.1/servers/f871c675-3fa2-4f43-8915-d15a01dbe06f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:13:49.743494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:49.744966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:49.754247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.755098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.756160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:49.756844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:49.763358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:49.782093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f1246966-f142-42c8-b296-d9a71978aed0 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1574 microversion: 2.1 time: 0.795160 Apr 05 12:13:49.794186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 437/916] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:48 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1574 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:49.882711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5509d9b2-67b8-483f-98bd-149ffe4fe670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 27220 microversion: 2.20 time: 0.145240 Apr 05 12:13:49.887383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 480/917] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:49 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 27220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:50.401865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:50.402426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:50.411842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.412562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.413614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.413900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-903cbbf4-b0b2-48cf-84b5-ef002dbadcf4 req-126334cd-dd46-4a38-94f0-c61ad7b596ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:50.414689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.416054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:50.416054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:50.428083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-903cbbf4-b0b2-48cf-84b5-ef002dbadcf4 req-126334cd-dd46-4a38-94f0-c61ad7b596ec service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.429188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-903cbbf4-b0b2-48cf-84b5-ef002dbadcf4 req-126334cd-dd46-4a38-94f0-c61ad7b596ec service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.451389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-903cbbf4-b0b2-48cf-84b5-ef002dbadcf4 req-126334cd-dd46-4a38-94f0-c61ad7b596ec service nova] Creating event network-changed:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:13:50.458406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-903cbbf4-b0b2-48cf-84b5-ef002dbadcf4 req-126334cd-dd46-4a38-94f0-c61ad7b596ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051007 Apr 05 12:13:50.459322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 481/918] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:13:50.519744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:50.520955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:50.538978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.539857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.543812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.545369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.620702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lazy-loading 'services' on Instance uuid 4ea8d077-e92a-40b0-8260-2af8a71b8adb {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:13:50.786175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3874707c-eeda-4c39-a01f-9d84858020f3 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments/cf960759-94e1-4fc4-84bc-48ecd6078733" status: 202 len: 0 microversion: 2.1 time: 0.388419 Apr 05 12:13:50.787425 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 438/919] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:13:50 2021] DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments/cf960759-94e1-4fc4-84bc-48ecd6078733 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:50.804141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:50.806296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:50.816470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.817091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.818247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.818834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.930283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1b2e44c0-a05a-4d38-a31d-bdee7658694e tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129522 Apr 05 12:13:50.931436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 439/920] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:50 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:50.936976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:50.937782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:50.946368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.947029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.948004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:50.948614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:50.988972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:51.027380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c569334c-3219-4819-a57e-e748377112b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1664 microversion: 2.1 time: 0.512550 Apr 05 12:13:51.028215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 482/921] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:50 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1664 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:51.048004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:51.054673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:51.076172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:51.076676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:51.077525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:51.078010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:51.232545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-be8ee9e2-dc02-469b-ab0a-e816c106c55f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 27704 microversion: 2.20 time: 0.189755 Apr 05 12:13:51.233259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 483/922] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:51 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 27704 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:51.273068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:51.283688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-18a23e18-ab6e-4231-876a-a5137ee165ab tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1507 microversion: 2.1 time: 0.350907 Apr 05 12:13:51.284325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 440/923] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:50 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:51.945272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:51.946634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:51.956687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:51.957201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:51.958281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:51.958752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.028039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d7a860de-a22a-44bb-8509-d729bb76ab1a tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088668 Apr 05 12:13:52.028590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 484/924] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:51 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:52.044956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:52.045737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:52.054573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.055148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.056050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.056620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.245600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:52.246718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:52.254799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.256102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.257001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.257507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.278749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:52.288139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-57a806a4-46cb-40e6-a76a-9eb11d4149bf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1668 microversion: 2.1 time: 0.247163 Apr 05 12:13:52.289106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 441/925] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:52 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:52.302009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:52.302863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:52.311102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.311751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.312700 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.313352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.453189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:52.462082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a004daeb-063b-4d8b-ac79-5806de09102c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1223 microversion: 2.1 time: 0.164995 Apr 05 12:13:52.462754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 442/926] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:52 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1223 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:52.475983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-fce86fcb-5eaf-4ffe-b352-6a4b5bbd2908 req-5ecc5958-28af-4540-85d5-fbc22fa3a749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f627d1-6185-40fa-8a66-bf568242e6c1", "name": "network-vif-deleted", "tag": "75dc0cbf-733b-4036-b284-69bfcafbac18"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:52.477656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:13:52.477656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:13:52.486988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fce86fcb-5eaf-4ffe-b352-6a4b5bbd2908 req-5ecc5958-28af-4540-85d5-fbc22fa3a749 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:52.487615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-fce86fcb-5eaf-4ffe-b352-6a4b5bbd2908 req-5ecc5958-28af-4540-85d5-fbc22fa3a749 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:52.504671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-fce86fcb-5eaf-4ffe-b352-6a4b5bbd2908 req-5ecc5958-28af-4540-85d5-fbc22fa3a749 service nova] Creating event network-vif-deleted:75dc0cbf-733b-4036-b284-69bfcafbac18 for instance 62f627d1-6185-40fa-8a66-bf568242e6c1 on hv-cinder-78476 Apr 05 12:13:52.509619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-fce86fcb-5eaf-4ffe-b352-6a4b5bbd2908 req-5ecc5958-28af-4540-85d5-fbc22fa3a749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Apr 05 12:13:52.510302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 443/927] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:13:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:53.041515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:53.042695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:53.051317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:53.051815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:53.052637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:53.053126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:53.121125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-24eca7f6-288c-4516-a8af-1a649079494b tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084221 Apr 05 12:13:53.121752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 444/928] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:53 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:13:53.479944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:53.480660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:53.488643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:53.489149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:53.490073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:53.490587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:53.618916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:53.627973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a1c37a1-66c8-4003-a038-749849eba739 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1223 microversion: 2.1 time: 0.152087 Apr 05 12:13:53.628629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 445/929] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:53 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:54.134220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:54.135255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:54.143714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:54.144216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:54.145041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:54.145528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:54.212440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-511dbcfb-147f-43a2-a9b0-dc88389b9caa tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082469 Apr 05 12:13:54.213064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 446/930] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:54 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:13:54.645941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:54.646639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:54.654680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:54.655185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:54.656011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:54.656502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:54.777592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:54.786504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d32c2ad1-bb2d-4e53-a684-2920a22366b6 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1223 microversion: 2.1 time: 0.144659 Apr 05 12:13:54.787128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 447/931] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:54 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:55.225303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:55.226374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:55.234104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:55.234661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:55.235499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:55.235987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:55.302822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-034e3cee-3795-4716-bbcf-c211ee779d22 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082393 Apr 05 12:13:55.303445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 448/932] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:55 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:13:55.804444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:55.805119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:55.812942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:55.813450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:55.814314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:55.814810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:55.850756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8e6f0304-57bd-41b7-8e5a-2bb79c43688e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28058 microversion: 2.20 time: 3.609072 Apr 05 12:13:55.852171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 485/933] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:52 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28058 bytes in 3611 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:55.939626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:55.949124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a55ccdb9-5bef-4043-b84d-2eed37870160 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1223 microversion: 2.1 time: 0.148726 Apr 05 12:13:55.949752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 449/934] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:55 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:13:56.315577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:56.316743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:56.325293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.325800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:56.326667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.327157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:56.393574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-881d695c-f3ed-42f3-a177-c91fe4699ad9 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082530 Apr 05 12:13:56.394218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 486/935] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:56 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:13:56.863327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:56.865859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:56.875634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.876139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:56.876985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.877472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:56.968354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:56.969030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:56.982473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1c89c763-0cc0-4ed3-a118-50473c8f901d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.122826 Apr 05 12:13:56.983344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 450/936] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:56 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:56.987519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.988048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:56.988941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:56.989486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.074690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:57.075211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.075726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lazy-loading 'fault' on Instance uuid 62f627d1-6185-40fa-8a66-bf568242e6c1 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:13:57.157814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:57.165930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-499fa605-6055-40f9-90b9-5050ac7a2500 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 200 len: 1182 microversion: 2.1 time: 0.202626 Apr 05 12:13:57.166583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 487/937] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:56 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 1182 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:57.406465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:57.407645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:57.416123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:57.416622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.417447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:57.417935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.483458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8373c27f-5ed3-425d-b8d5-c57d579a92ed tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081705 Apr 05 12:13:57.484066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 451/938] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:13:57 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:13:57.495088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:57.495639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:57.503782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:57.504293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.505779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:57.506292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:57.672183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] HTTP exception thrown: Instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb is not attached to volume cf960759-94e1-4fc4-84bc-48ecd6078733 Apr 05 12:13:57.672841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Returning 404 to user: Instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb is not attached to volume cf960759-94e1-4fc4-84bc-48ecd6078733 {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:13:57.673730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bedec9bd-777d-4d8f-9dff-b9a51263d5e6 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments/cf960759-94e1-4fc4-84bc-48ecd6078733" status: 404 len: 154 microversion: 2.1 time: 0.182913 Apr 05 12:13:57.674355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 488/939] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:13:57 2021] DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb/os-volume_attachments/cf960759-94e1-4fc4-84bc-48ecd6078733 => generated 154 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:13:57.995472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:57.996510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:58.004385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:58.004923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:58.005838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:58.006361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:58.102207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1c83af4a-f57b-4d13-aa07-dc56f6b94a30 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.110535 Apr 05 12:13:58.103200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 452/940] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:57 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:58.184120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:58.184794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:58.192657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:58.193103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:58.193933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:58.194479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:58.249145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] HTTP exception thrown: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. Apr 05 12:13:58.249821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Returning 404 to user: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:13:58.250752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5d92c7a6-dafa-4ab9-a3f9-8ae4308b2755 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 404 len: 111 microversion: 2.1 time: 0.070695 Apr 05 12:13:58.251371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 489/941] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:58 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:13:58.365242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1764379716", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-9640565", "security_groups": [{"name": "tempest-secgroup-smoke-398527571"}], "block_device_mapping_v2": [{"uuid": "1ebc0314-6a02-4518-a1c8-225abbfddbb0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e4dca9-c22e-4b2f-b50e-39573f778a69"}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:58.547206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] validate_networks() for [('a3e4dca9-c22e-4b2f-b50e-39573f778a69', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:13:59.045819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:59.046540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:59.055879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.056507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.057447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.058182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.137001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:13:59.252885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e2c78e12-32b7-4813-9bec-298d61d5db41 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 204 len: 0 microversion: 2.1 time: 0.210901 Apr 05 12:13:59.253623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 490/942] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:13:59 2021] DELETE /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:13:59.259690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:13:59.261005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:59.268687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.269191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.270039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.270590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.349016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:13:59.349630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:13:59.350211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:13:59.350714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:13:59.351176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:13:59.360105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.360603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.361468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.361950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.367450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-49a0279d-2d2a-4ddf-82c8-12afbd3c0c20 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.112457 Apr 05 12:13:59.371590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 491/943] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:13:59 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:13:59.373540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:59.374340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:59.381832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:13:59.383098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.383613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.384458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:13:59.384951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:13:59.386451 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for user 75522f4b270e42e4b1ce7a6a09beb7ec and project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:13:59.498298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:13:59.501156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ebc0314-6a02-4518-a1c8-225abbfddbb0',volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:13:59.627710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:59.638079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0c0df573-7daa-4a62-a584-6c80ddcaa4cf tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1554 microversion: 2.1 time: 0.267968 Apr 05 12:13:59.638938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 492/944] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:59 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1554 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:13:59.684800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28adcf09-c84a-47b2-bdfa-fc8728500cd1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.324215 Apr 05 12:13:59.685694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 453/945] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:13:58 2021] POST /compute/v2.1/servers => generated 405 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:13:59.696413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0ad5cfb8-dd5c-4f4e-bf63-fc884b00c319 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:13:59.697093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ad5cfb8-dd5c-4f4e-bf63-fc884b00c319 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:13:59.780179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0ad5cfb8-dd5c-4f4e-bf63-fc884b00c319 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:13:59.790608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0ad5cfb8-dd5c-4f4e-bf63-fc884b00c319 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1092 microversion: 2.1 time: 0.098321 Apr 05 12:13:59.791406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 493/946] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:13:59 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1092 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:00.379247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:00.380440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:00.388568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.389074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.389902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.390450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.512902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-459f9644-c1ad-4ea0-9abb-7de4cda97157 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.137819 Apr 05 12:14:00.513615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 454/947] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:00 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:00.657447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:00.658037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:00.667603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.668114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.668947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.669438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.808493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:00.809736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:00.819244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.819902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.820859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:00.821456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:00.899627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:00.908801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-404b49aa-30f2-4029-8d20-9d0155f8706f tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1554 microversion: 2.1 time: 0.255369 Apr 05 12:14:00.909670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 494/948] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:00 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1554 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:00.977601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:00.988207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ccce6dcb-b083-4b58-b8a8-d088a137b51e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1208 microversion: 2.1 time: 0.184096 Apr 05 12:14:00.998874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 455/949] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:00 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:01.525485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:01.526945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:01.534798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:01.535300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:01.536657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:01.537145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:01.645850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dbe612af-f734-4a67-9e83-b623d0fb9b60 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.124031 Apr 05 12:14:01.647007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 495/950] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:01 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:01.927635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:01.928497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:01.937341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:01.937952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:01.938940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:01.939506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:02.007732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:02.008811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:02.017677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:02.018207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:02.019073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:02.019563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:02.198272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:02.207159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bc77111d-3d48-4538-82de-76d6838c8d2c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1554 microversion: 2.1 time: 0.284273 Apr 05 12:14:02.207920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 456/951] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:01 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:02.265854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:02.274876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c1c19df3-563d-43bd-819a-c123c39a3abb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.271748 Apr 05 12:14:02.275495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 496/952] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:02 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:02.658511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:02.659474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:02.667943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:02.668449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:02.669271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:02.669756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:03.226173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:03.226857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:03.235523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:03.236028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:03.236857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:03.237344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:03.451276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:03.460206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b5ab4723-17d1-4717-b693-d0e855261aea tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1554 microversion: 2.1 time: 0.238618 Apr 05 12:14:03.460819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 497/953] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:03 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:03.465415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:03.466050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:03.473352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:03.473848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:03.474724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:03.475211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:03.681358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:03.690211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db1e41a9-7ee8-458b-8ce8-3de52e4da6df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.228359 Apr 05 12:14:03.690834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 498/954] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:03 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:04.478047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:04.478841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:04.487000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:04.487512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:04.488365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:04.488894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:04.915409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:04.924493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9cbab8bf-bee9-403b-9ff2-4abe091ac286 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1554 microversion: 2.1 time: 0.451163 Apr 05 12:14:04.935663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 499/955] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:04 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1554 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:04.935663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:04.935663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:04.938790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:04.939302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:04.940144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:04.940625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:05.372687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:05.385189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b99ae180-986d-4242-9209-dffef511207a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.458916 Apr 05 12:14:05.386045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 500/956] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:04 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:05.666493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-0a69ed13-ab81-4066-a421-638b16f174ba req-fd371ad3-c527-4474-8624-334ec36d2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8d077-e92a-40b0-8260-2af8a71b8adb", "name": "network-vif-deleted", "tag": "cd022a21-f8f6-48a0-aafb-3a959f94237a"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:05.668606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:14:05.668606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:14:05.677854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a69ed13-ab81-4066-a421-638b16f174ba req-fd371ad3-c527-4474-8624-334ec36d2ffe service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:05.678365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a69ed13-ab81-4066-a421-638b16f174ba req-fd371ad3-c527-4474-8624-334ec36d2ffe service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:05.695782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-0a69ed13-ab81-4066-a421-638b16f174ba req-fd371ad3-c527-4474-8624-334ec36d2ffe service nova] Creating event network-vif-deleted:cd022a21-f8f6-48a0-aafb-3a959f94237a for instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb on hv-cinder-78476 Apr 05 12:14:05.700792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-0a69ed13-ab81-4066-a421-638b16f174ba req-fd371ad3-c527-4474-8624-334ec36d2ffe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Apr 05 12:14:05.701440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 501/957] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:14:05.800663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-663e28a7-d799-44a2-95bf-38c9b07532dd req-ddac8269-1924-4793-a41e-707df15f2848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc997f-f2bd-49e8-8b8e-3b4309eb377f", "tag": "ef738c12-6b44-4d39-8163-db9d3a41f6f9"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:05.804635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:14:05.804635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:14:05.814087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-663e28a7-d799-44a2-95bf-38c9b07532dd req-ddac8269-1924-4793-a41e-707df15f2848 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:05.814661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-663e28a7-d799-44a2-95bf-38c9b07532dd req-ddac8269-1924-4793-a41e-707df15f2848 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:05.832286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-663e28a7-d799-44a2-95bf-38c9b07532dd req-ddac8269-1924-4793-a41e-707df15f2848 service nova] Creating event network-changed:ef738c12-6b44-4d39-8163-db9d3a41f6f9 for instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f on hv-cinder-78476 Apr 05 12:14:05.838237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-663e28a7-d799-44a2-95bf-38c9b07532dd req-ddac8269-1924-4793-a41e-707df15f2848 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042314 Apr 05 12:14:05.839081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 502/958] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:14:05.944618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:05.945389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:05.954513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:05.955067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:05.955928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:05.956419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:05.965439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9e50006b-30ef-45cb-a021-536190e8d712 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 3.310729 Apr 05 12:14:05.966431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 457/959] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:02 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 3313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:06.397714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67efaaee9b0744adb38846ef92d9a878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa3ed41777846009e78f090b026e395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:06.403911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:06.404691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:06.408210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4297e3dd-9b62-4699-9b9f-ead38489da7d tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 200 len: 1512 microversion: 2.1 time: 0.467908 Apr 05 12:14:06.408369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 503/960] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:05 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:06.413360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:06.413870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:06.414743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:06.415232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:06.640238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:06.649125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3b2c2e02-f493-4e3f-994b-ef33321cfc5c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.249962 Apr 05 12:14:06.649694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 458/961] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:06 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:06.977746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:06.978989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:06.986806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:06.987315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:06.988154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:06.988665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:07.111550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b5349cb0-ec0a-4cdd-b57c-a79e58e331fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.137140 Apr 05 12:14:07.112529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 504/962] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:06 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:07.426245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:07.427021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] [instance: 4ea8d077-e92a-40b0-8260-2af8a71b8adb] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:07.435189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:07.435684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:07.436510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:07.436996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:07.488608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] HTTP exception thrown: Instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb could not be found. Apr 05 12:14:07.489390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Returning 404 to user: Instance 4ea8d077-e92a-40b0-8260-2af8a71b8adb could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:14:07.490323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-889dc0d4-bdd2-4954-918c-b3f7e04f2048 tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb" status: 404 len: 111 microversion: 2.1 time: 0.068127 Apr 05 12:14:07.490907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 459/963] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:07 2021] GET /compute/v2.1/servers/4ea8d077-e92a-40b0-8260-2af8a71b8adb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:14:07.500515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9cd3335-6e27-4509-8be5-d50b63487b0c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] Calling method '.version_select at 0x7f0100f2c840>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:07.517956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9cd3335-6e27-4509-8be5-d50b63487b0c tempest-TestMinimumBasicScenario-484717768 tempest-TestMinimumBasicScenario-484717768-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1222345277" status: 202 len: 0 microversion: 2.1 time: 0.022062 Apr 05 12:14:07.518581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 505/964] 10.222.0.36 () {58 vars in 1262 bytes} [Mon Apr 5 12:14:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1222345277 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:07.671384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:07.674685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:07.688789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:07.695688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:07.696595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:07.697095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:08.125254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:08.127054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:08.163696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:08.164247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:08.165147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:08.165637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:08.250460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:08.262736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-959f2411-21e6-41e1-8b5e-7fae118325df tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.597135 Apr 05 12:14:08.274368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 460/965] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:07 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:08.370442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f983d925-5477-4669-af3b-141aaf8bb944 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.249382 Apr 05 12:14:08.382628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 506/966] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:08 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:09.281654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:09.282995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:09.290725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:09.291230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:09.292056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:09.292540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:09.393833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:09.395031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:09.403813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:09.404318 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:09.405152 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:09.405635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:09.508595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e55c03f4-fa9a-4763-9557-27c06ef6c3ee tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.119070 Apr 05 12:14:09.510166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 507/967] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:09 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:09.734403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:09.744910 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9289a13-e961-4ab2-997b-a70f3c31ff06 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.467414 Apr 05 12:14:09.745829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 461/968] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:09 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:10.522670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:10.523868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:10.532623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:10.533130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:10.533969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:10.534491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:10.636614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1469222c-ab14-4da9-8569-38d5a60c6c0a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.118870 Apr 05 12:14:10.641170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 508/969] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:10 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:10.764481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:10.765361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:10.774431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:10.774942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:10.776006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:10.776677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:11.455256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:11.464043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c835e487-9222-45d7-a82e-829d592c5894 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.704320 Apr 05 12:14:11.464674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 462/970] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:10 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:11.650587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:11.652013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:11.661396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:11.661664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:11.662628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:11.663125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:11.913455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4f0210d5-42cb-4e3f-87db-a2bbb6de1e58 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.267086 Apr 05 12:14:11.914845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 509/971] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:11 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:12.482790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:12.483629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:12.496341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:12.496953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:12.497907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:12.498541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:12.927461 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:12.928600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:12.937311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:12.937816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:12.938690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:12.939190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:13.031502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:13.039986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-89e8048f-1279-4dd6-8cb7-16b9383f2fc6 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.117291 Apr 05 12:14:13.041901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eb237eb2-5cd6-4149-9908-7e4f5344b7ac tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.563323 Apr 05 12:14:13.044858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 510/972] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:12 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:14:13.044963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 463/973] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:12 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:14.054886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:14.061509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:14.062300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:14.065570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:14.077965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:14.082673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:14.083215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:14.084149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:14.084985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:14.088469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:14.089538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:14.090230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:14.271514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a4cab0f4-659a-4cbd-924f-1783fd98a737 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.222174 Apr 05 12:14:14.273403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 511/974] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:14 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:14.569805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:14.581265 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a48e3dd2-1214-4596-ad9d-b58e656a2b9c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.523741 Apr 05 12:14:14.592546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 464/975] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:14 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:14:15.285222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:15.286566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:15.295072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:15.295570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:15.296405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:15.296888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:15.402995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-43931c2d-a782-44a5-ab53-5c09f330364a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.121975 Apr 05 12:14:15.403731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 512/976] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:15 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:15.599927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:15.600732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:15.608663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:15.609168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:15.609987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:15.610845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:15.889315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:15.903160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-98e91bea-0476-467c-a2cf-aaed2b142faa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.306186 Apr 05 12:14:15.903909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 465/977] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:15 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:16.417034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:16.418206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:16.427310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:16.427796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:16.428851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:16.429526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:16.526902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7dce84d6-b079-4757-85fa-b5a837c9684c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.114174 Apr 05 12:14:16.531334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 513/978] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:16 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:16.920882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:16.922114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:16.930609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:16.931124 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:16.931973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:16.932471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:17.155016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:17.164683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-560e2937-5e73-4fe4-8d22-30530671397d tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.247815 Apr 05 12:14:17.165326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 466/979] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:16 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:17.541616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:17.542773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:17.553689 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:17.554634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:17.555704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:17.556382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:17.666618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e4193d4-2448-4bff-a309-627a7ad374fc tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28175 microversion: 2.20 time: 0.130503 Apr 05 12:14:17.668256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 514/980] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:17 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28175 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:17.687865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-f9c21bb3-0204-44ea-954b-901051beb95b req-719ec7e0-ab17-4332-aec4-8c3beede54f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc997f-f2bd-49e8-8b8e-3b4309eb377f", "name": "network-vif-plugged", "status": "completed", "tag": "ef738c12-6b44-4d39-8163-db9d3a41f6f9"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:17.689573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:14:17.689573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:14:17.699111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f9c21bb3-0204-44ea-954b-901051beb95b req-719ec7e0-ab17-4332-aec4-8c3beede54f9 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:17.699634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-f9c21bb3-0204-44ea-954b-901051beb95b req-719ec7e0-ab17-4332-aec4-8c3beede54f9 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:17.718271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-f9c21bb3-0204-44ea-954b-901051beb95b req-719ec7e0-ab17-4332-aec4-8c3beede54f9 service nova] Creating event network-vif-plugged:ef738c12-6b44-4d39-8163-db9d3a41f6f9 for instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f on hv-cinder-78476 Apr 05 12:14:17.724201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-f9c21bb3-0204-44ea-954b-901051beb95b req-719ec7e0-ab17-4332-aec4-8c3beede54f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039590 Apr 05 12:14:17.725044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 467/981] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:18.184237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:18.185005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:18.193575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:18.194084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:18.194943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:18.195426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:18.680864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:18.681938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:18.690296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:18.690800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:18.692294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:18.693111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:18.829189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-daad8e26-77da-4654-8146-0b4c667bdb4f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28466 microversion: 2.20 time: 0.153352 Apr 05 12:14:18.829946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 468/982] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:18 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:14:18.846854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:18.857023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e5dfc4f-2253-4aac-9cb9-3e097db73f4b tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1263 microversion: 2.1 time: 0.677355 Apr 05 12:14:18.857840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 515/983] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:18 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1263 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:19.842662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:19.845002 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:19.856022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:19.857254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:19.858360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:19.859481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:19.876269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:19.877186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:19.898859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:19.899672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:19.900749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:19.901683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:19.985180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-97685fb0-7c3d-4c06-9e98-68015df0e1b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28466 microversion: 2.20 time: 0.147325 Apr 05 12:14:19.986594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 469/984] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:19 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:20.308613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:20.323962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-552f4186-acc9-4c79-a4b3-c78bd635d365 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1450 microversion: 2.1 time: 0.451696 Apr 05 12:14:20.324879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 516/985] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:19 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1450 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:20.344292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:20.346196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:20.357184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:20.364852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:20.366660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:20.367177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:20.766947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:20.777125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3ae8f034-999d-4e8a-ad4d-ded3cdd40e3a tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1450 microversion: 2.1 time: 0.437402 Apr 05 12:14:20.777943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 470/986] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:20 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1450 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:20.997481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:20.998755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:21.008123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:21.008757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:21.009781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:21.010435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:21.120120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d5228c1c-4e6d-47de-abfd-7a7fc0aaccbd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.124057 Apr 05 12:14:21.121136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 517/987] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:20 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:22.133853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:22.135914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:22.153627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:22.155056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:22.161003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:22.162056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:22.262391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7dc966db-2868-4e92-86d9-2069bb5a7212 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.133342 Apr 05 12:14:22.263899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 471/988] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:22 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:23.277131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:23.278388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:23.288000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:23.288507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:23.289529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:23.290020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:23.390995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c3e3cddc-9912-4680-9d33-6cc031eb32b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.118487 Apr 05 12:14:23.395364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 518/989] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:23 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:23.896009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-4c4ed887-b9ab-483f-bf61-0ab532e9a227 req-e6fd015e-e2ac-4b66-9a56-8cab68c0a05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc997f-f2bd-49e8-8b8e-3b4309eb377f", "tag": "ef738c12-6b44-4d39-8163-db9d3a41f6f9"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:23.897682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:14:23.897682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:14:23.907634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-4c4ed887-b9ab-483f-bf61-0ab532e9a227 req-e6fd015e-e2ac-4b66-9a56-8cab68c0a05b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:23.908133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-4c4ed887-b9ab-483f-bf61-0ab532e9a227 req-e6fd015e-e2ac-4b66-9a56-8cab68c0a05b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:23.925469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-4c4ed887-b9ab-483f-bf61-0ab532e9a227 req-e6fd015e-e2ac-4b66-9a56-8cab68c0a05b service nova] Creating event network-changed:ef738c12-6b44-4d39-8163-db9d3a41f6f9 for instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f on hv-cinder-78476 Apr 05 12:14:23.931037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-4c4ed887-b9ab-483f-bf61-0ab532e9a227 req-e6fd015e-e2ac-4b66-9a56-8cab68c0a05b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040014 Apr 05 12:14:23.931672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 472/990] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:24.403902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:24.405091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:24.414148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:24.414847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:24.415859 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:24.416537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:24.530617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-725ca5ff-3098-41b5-be60-24d5b8711e35 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.131284 Apr 05 12:14:24.531382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 519/991] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:24 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:25.544304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:25.545423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:25.554431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:25.554945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:25.555805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:25.556299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:25.661525 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5f50be7d-51e2-45e9-9fbb-ba2b42eda161 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.121282 Apr 05 12:14:25.665668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 473/992] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:25 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:26.674163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:26.675355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:26.684915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:26.685424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:26.686317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:26.686817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:26.782931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b746805d-a8dc-40a5-819e-d50ef8ac0b9f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.113016 Apr 05 12:14:26.783920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 520/993] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:26 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:27.796545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:27.798078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:27.807484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:27.807995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:27.808841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:27.809331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:27.914010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5c8af818-4f4c-4b02-a4a9-38358d9469c7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.121697 Apr 05 12:14:27.915383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 474/994] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:27 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:28.928176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:28.929250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:28.937894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:28.938459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:28.939301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:28.939792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:29.047464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-718b3d2d-c9eb-4de3-9f7d-d78d288d6876 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.124282 Apr 05 12:14:29.052195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 521/995] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:28 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:30.061574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:30.063561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:30.073465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:30.073951 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:30.075054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:30.075720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:30.210832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e1967b1b-eaf0-409a-a504-f8902bee3e11 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.153502 Apr 05 12:14:30.211729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 475/996] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:30 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:31.225735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:31.227032 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:31.235714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:31.236196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:31.237220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:31.237688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:31.337062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b22d9b5-c379-4095-ba31-dfc0386e5ea0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.116625 Apr 05 12:14:31.338078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 522/997] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:31 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:32.352249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:32.354194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:32.364197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:32.364949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:32.365884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:32.366581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:32.480728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-68ccb88f-f88c-40e1-9914-b1daf4e22074 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.134918 Apr 05 12:14:32.485302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 476/998] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:32 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:33.494368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:33.495546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:33.506280 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:33.506803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:33.507675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:33.508220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:33.656583 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-19747d6c-55fc-4463-b9f2-875121027223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.166728 Apr 05 12:14:33.657551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 523/999] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:33 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:34.670574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:34.672342 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:34.684551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:34.685163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:34.686022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:34.686551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:34.933719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1865fbd0-989a-476f-9a00-2642d348692b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.267754 Apr 05 12:14:34.934661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 477/1000] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:34 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:35.948091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:35.949381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:35.958349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:35.958722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:35.959548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:35.960186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:36.175016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b5d5fadd-075b-40f2-9622-7034b4cadcf8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.231920 Apr 05 12:14:36.175825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 524/1001] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:35 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:37.189243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:37.191176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:37.201200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:37.201876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:37.203058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:37.203715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:37.316970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-933d95e4-8ee6-440f-9589-35f4a241d13f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.132264 Apr 05 12:14:37.317933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 478/1002] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:37 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 05 12:14:38.330823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:38.332281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:38.355556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:38.362899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:38.366057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:38.375907 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:38.531163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e23f9c88-71b9-4b05-8408-1778506a0be1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.205258 Apr 05 12:14:38.532174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 525/1003] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:38 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:39.546101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:39.548158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:39.561281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:39.562189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:39.563284 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:39.563967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:39.691581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d986b9bf-30c7-4e3b-b7a2-b0aea7e038d5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.150176 Apr 05 12:14:39.692899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 479/1004] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:39 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:40.705260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:40.708191 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:40.717505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:40.718012 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:40.718901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:40.719397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:40.823204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-976bc157-0ab0-4602-bbad-7fa0d0846f6a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.122561 Apr 05 12:14:40.824385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 526/1005] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:40 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:41.168946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Action: 'create', calling method: .version_select at 0x7f0101aeff28>, body: {"keypair": {"name": "tempest-TestShelveInstance-985921536"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:41.192731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:14:41.197118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for user d2614465974a47cf867b038558815d3d and project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:14:41.675112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:14:41.683173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for user d2614465974a47cf867b038558815d3d and project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:14:41.699194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bb56065e-543c-44d1-bb4b-95a384c4f2ee tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.726304 Apr 05 12:14:41.699860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 480/1006] 10.222.0.36 () {60 vars in 1148 bytes} [Mon Apr 5 12:14:40 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:41.836953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:41.838828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:41.848021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:41.848918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:41.849760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:41.850476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:41.964023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-523300e1-1ac0-4560-860c-a06c7231e7ba tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.132020 Apr 05 12:14:41.964782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 527/1007] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:41 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:42.977207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:42.978386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:42.987192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:42.987694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:42.988587 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:42.989075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:43.086497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fcfcd700-0f27-4bc9-8adb-d1eed5a03518 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.114452 Apr 05 12:14:43.087308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 481/1008] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:42 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:44.099919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:44.101690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:44.112140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:44.112658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:44.114054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:44.115108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:44.219673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9fad95db-2798-45bd-9c4a-88dc53da5f67 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.124191 Apr 05 12:14:44.220372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 528/1009] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:44 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:45.233595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:45.234867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:45.243538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:45.244122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:45.244960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:45.245450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:45.347807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-04f7eba8-1663-43c1-bc39-c43ab508c327 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.118481 Apr 05 12:14:45.348598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 482/1010] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:45 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:46.362992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:46.365031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:46.382018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:46.382565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:46.383429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:46.383932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:46.489870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8f5b7789-2375-4268-befc-a5b735d6b26e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.132547 Apr 05 12:14:46.491052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 529/1011] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:46 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:47.502070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:47.503263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:47.512870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:47.513638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:47.514528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:47.515016 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:47.621065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b619911c-8876-4480-b509-40ad66bc3dd0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.123328 Apr 05 12:14:47.621763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 483/1012] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:47 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:48.634454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:48.635597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:48.643882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:48.644875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:48.645793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:48.646310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:48.745207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c0dd7ea5-8605-42ce-b376-8465506d690a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.115064 Apr 05 12:14:48.745896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 530/1013] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:48 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:49.758586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:49.759709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:49.768292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:49.768795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:49.770819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:49.771392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:49.873008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4548c1e7-c18e-4837-8086-ad0b329d130f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.119333 Apr 05 12:14:49.874082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 484/1014] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:49 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:50.886108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:50.887310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:50.896270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:50.896784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:50.897610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:50.898095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:51.016733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ca33170c-4e23-4569-b7b3-4ebfb585f9de tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 28634 microversion: 2.20 time: 0.134880 Apr 05 12:14:51.017445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 531/1015] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:50 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 28634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:52.030759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:52.031985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:52.041183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:52.041702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:52.042567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:52.043065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:52.154940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-47794bf1-efb3-41b4-8718-abf246228a1c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 29896 microversion: 2.20 time: 0.128770 Apr 05 12:14:52.155677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 485/1016] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:52 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 29896 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:53.168825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:53.169982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:53.179456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:53.179968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:53.180822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:53.181315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:53.278184 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e68cbc38-b452-4274-b3fe-7abcaf102e4a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 31665 microversion: 2.20 time: 0.113873 Apr 05 12:14:53.278877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 532/1017] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:53 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 31665 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:54.291857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:54.293003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:54.301707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:54.302241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:54.303079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:54.303573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:54.413015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-99d08325-f3ae-4f9a-9622-46f25610b670 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 32779 microversion: 2.20 time: 0.125555 Apr 05 12:14:54.413648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 486/1018] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:54 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 32779 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:55.425945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:55.427106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:55.435696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:55.436203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:55.437034 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:55.437519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:55.539025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c6faa3fa-c543-4d79-9056-76c284bcde21 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 33710 microversion: 2.20 time: 0.117477 Apr 05 12:14:55.539696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 533/1019] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:55 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 33710 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:55.845676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:55.846356 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:55.855093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:55.855604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:55.856443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:55.856937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:55.920822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:14:56.036052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4d0450ee-be2f-4ce3-ab0f-3461839a83a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 204 len: 0 microversion: 2.1 time: 0.194216 Apr 05 12:14:56.036575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 487/1020] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:14:55 2021] DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:14:56.046025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:56.046855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:56.055885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:56.056395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:56.057239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:56.057728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:56.277522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:56.287092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a613c47e-7d90-45c1-ba0f-fc2c77585cb5 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1674 microversion: 2.1 time: 0.245674 Apr 05 12:14:56.287719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 534/1021] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:56 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:56.553564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:56.554775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:56.562562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:56.563077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:56.563921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:56.564415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:56.686324 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-07eb624e-2ab8-4ed1-a061-2c7dcff04582 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 34792 microversion: 2.20 time: 0.137796 Apr 05 12:14:56.690687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 488/1022] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:56 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 34792 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:57.306224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:57.306778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:57.315188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:57.315759 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:57.316644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:57.317139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:57.522959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:57.532102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0229b7dc-74d0-4fa6-872f-cfd22a857c15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1674 microversion: 2.1 time: 0.230040 Apr 05 12:14:57.532738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 535/1023] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:57 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:57.699632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:57.700820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:57.709905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:57.710440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:57.711269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:57.711756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:57.817221 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2771d7ae-1e93-4948-84a6-99a5cd54c5f5 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 35692 microversion: 2.20 time: 0.121859 Apr 05 12:14:57.818316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 489/1024] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:57 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 35692 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:58.551288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:58.552000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:58.559737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:58.560219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:58.561050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:58.561531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:58.690232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:58.700033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ed148cd6-7f40-48f4-a836-f35bd921217b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1607 microversion: 2.1 time: 0.153027 Apr 05 12:14:58.700664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 536/1025] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:58 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1607 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:58.832321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:58.833540 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:58.842398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:58.842906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:58.843743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:58.844228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:58.943566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e0c3984d-9372-41b5-bd8e-73ea83acb715 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 37257 microversion: 2.20 time: 0.116801 Apr 05 12:14:58.945336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 490/1026] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:58 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 37257 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:14:59.323598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-486d6769-e1dc-4696-81b8-97a069917e8f req-1015ff28-92c3-4b80-bacd-3cbff8a8408a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65c1062-5d66-496a-ae26-06d7d61b2fed", "name": "network-vif-deleted", "tag": "d2955123-ae33-4531-94cd-a14eaa61a2ca"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:59.325740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:14:59.325740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:14:59.336604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-486d6769-e1dc-4696-81b8-97a069917e8f req-1015ff28-92c3-4b80-bacd-3cbff8a8408a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.337394 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-486d6769-e1dc-4696-81b8-97a069917e8f req-1015ff28-92c3-4b80-bacd-3cbff8a8408a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:59.358659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-486d6769-e1dc-4696-81b8-97a069917e8f req-1015ff28-92c3-4b80-bacd-3cbff8a8408a service nova] Creating event network-vif-deleted:d2955123-ae33-4531-94cd-a14eaa61a2ca for instance a65c1062-5d66-496a-ae26-06d7d61b2fed on hv-cinder-78476 Apr 05 12:14:59.365829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-486d6769-e1dc-4696-81b8-97a069917e8f req-1015ff28-92c3-4b80-bacd-3cbff8a8408a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045561 Apr 05 12:14:59.366538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 537/1027] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:14:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:14:59.720063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:14:59.720852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:59.730625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.731147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:59.732047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.732543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:59.810057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.810841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:59.811357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lazy-loading 'fault' on Instance uuid a65c1062-5d66-496a-ae26-06d7d61b2fed {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:14:59.895102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:14:59.904389 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28656335-aab9-402a-be1e-45834a038484 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 200 len: 1328 microversion: 2.1 time: 0.188976 Apr 05 12:14:59.905254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 491/1028] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:14:59 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 1328 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:14:59.957646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:14:59.958888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:14:59.967571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.968079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:14:59.968937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:14:59.969421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:00.074611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-12ab0329-615e-4d4f-90ae-e80a081e3e25 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 38188 microversion: 2.20 time: 0.121944 Apr 05 12:15:00.075585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 538/1029] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:14:59 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 38188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:00.922292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:00.922967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:00.931397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:00.931906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:00.932735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:00.933224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:00.988515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. Apr 05 12:15:00.989174 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:15:00.990067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a6496e17-c210-48db-a8e2-57113fc53c0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 404 len: 111 microversion: 2.1 time: 0.071932 Apr 05 12:15:00.990708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 492/1030] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:00 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:15:01.000314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e2d2efc5-db14-4082-b908-83343c95c7e4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '.version_select at 0x7f0100ee5268>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:01.020273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e2d2efc5-db14-4082-b908-83343c95c7e4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304852366" status: 202 len: 0 microversion: 2.1 time: 0.024142 Apr 05 12:15:01.024523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 539/1031] 10.222.0.36 () {58 vars in 1211 bytes} [Mon Apr 5 12:15:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304852366 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:01.088728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:01.090923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:01.100426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:01.101095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:01.101976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:01.102531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:01.223026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-14959447-389f-40c5-a7ed-c4a6d0554d6f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 38188 microversion: 2.20 time: 0.138427 Apr 05 12:15:01.227468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 493/1032] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:01 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 38188 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:02.235894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:02.237060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:02.246796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:02.247304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:02.248145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:02.248662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:02.359546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-40afe245-45e9-4517-978a-8d76a814a0d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 38188 microversion: 2.20 time: 0.127563 Apr 05 12:15:02.364712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 540/1033] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:02 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 38188 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:02.493147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: .version_select at 0x7f010059c8c8>, body: {"keypair": {"name": "tempest-keypair-857483574"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:02.516445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:15:02.520622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:15:02.642301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:15:02.646962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'key_pairs'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:15:02.660740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c5eab732-b882-4616-bb3b-5e36b2aa84dd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.172878 Apr 05 12:15:02.661388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 494/1034] 10.222.0.36 () {60 vars in 1148 bytes} [Mon Apr 5 12:15:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:03.373810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:03.375074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:03.384524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:03.385128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:03.386081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:03.386677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:03.494905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0278f261-75b6-40c8-82de-70a1dfb5c8d0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 38188 microversion: 2.20 time: 0.125617 Apr 05 12:15:03.495841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 541/1035] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:03 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 38188 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:04.509443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:04.511830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:04.523846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:04.524442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:04.525383 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:04.525939 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:04.634923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-09f07497-906e-4ead-b9ed-151b21dd0299 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 200 len: 38329 microversion: 2.20 time: 0.130531 Apr 05 12:15:04.640673 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 495/1036] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:04 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 38329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:15:04.647595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:04.648471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:04.658147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:04.658678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:04.659812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:04.660335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:04.726909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aff9d179-f52d-4aa3-91be-86c2afbb57db tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/ips" status: 200 len: 153 microversion: 2.20 time: 0.084613 Apr 05 12:15:04.727561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 542/1037] 10.222.0.36 () {60 vars in 1279 bytes} [Mon Apr 5 12:15:04 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/ips => generated 153 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:04.730260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1333420690", "imageRef": "962a64a4-b3f0-4afc-b129-368a9b5c3992", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1a45c1-5bda-4177-9f6d-4ce95f1005fb"}], "security_groups": [{"name": "tempest-securitygroup--1716046135"}], "key_name": "tempest-keypair-857483574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:04.872240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] validate_networks() for [('0d1a45c1-5bda-4177-9f6d-4ce95f1005fb', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:15:05.458301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:15:05.458782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:15:05.459334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:15:05.459841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:15:05.460355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:15:05.469239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:05.469752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:05.470659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:05.471159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:05.489615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:15:05.494025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Getting quotas for user d05b2cae18804218aa53adcf160327d1 and project 525c6898bd0b4bc98230f38ee54db7c6. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:15:05.505818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:15:05.508555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962a64a4-b3f0-4afc-b129-368a9b5c3992',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:15:05.561504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fb4757e4-4fd2-441f-8ac6-c338321ed69f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.837051 Apr 05 12:15:05.562091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 496/1038] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:15:04 2021] POST /compute/v2.1/servers => generated 402 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:15:05.573582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-48d9bacc-8b01-47f8-98f3-bab6d6658f3c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:05.574294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-48d9bacc-8b01-47f8-98f3-bab6d6658f3c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:05.667157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1789710696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-985921536", "security_groups": [{"name": "tempest-secgroup-smoke-410393403"}], "networks": [{"uuid": "a3a55611-a0f0-4df9-b637-46ecc7406414"}], "block_device_mapping_v2": [{"uuid": "4e6dcd3e-9f0a-47f0-8ed6-5ed4a1e1be35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:05.676843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-48d9bacc-8b01-47f8-98f3-bab6d6658f3c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:05.685009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-48d9bacc-8b01-47f8-98f3-bab6d6658f3c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1237 microversion: 2.1 time: 0.115517 Apr 05 12:15:05.685620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 543/1039] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:05 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:05.862805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] validate_networks() for [('a3a55611-a0f0-4df9-b637-46ecc7406414', None, None, None)] {{(pid=98311) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:15:06.471577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Flavor limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:15:06.472729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Image limits 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:15:06.473328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Flavor pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:15:06.473788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Image pref 0:0:0 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:15:06.474379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:15:06.483103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:06.483605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:06.484542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:06.485028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:06.503315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:15:06.507442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Getting quotas for user d2614465974a47cf867b038558815d3d and project 59ab3fb82a794070a1c024d576d5e87b. Resources: {'cores', 'ram', 'instances'} {{(pid=98311) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:15:06.619731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Going to run 1 instances... {{(pid=98311) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:15:06.622116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e6dcd3e-9f0a-47f0-8ed6-5ed4a1e1be35',volume_size=None,volume_type=None)] {{(pid=98311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:15:06.704983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:06.705844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:06.714918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:06.715440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:06.716285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:06.716779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:06.843908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5053831f-582a-4ac1-857a-e97d5b0c7072 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.180688 Apr 05 12:15:06.851497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 497/1040] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:15:05 2021] POST /compute/v2.1/servers => generated 405 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 05 12:15:06.856791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ba58d6a6-a7e2-47be-b86e-93069c225929 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:06.857654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ba58d6a6-a7e2-47be-b86e-93069c225929 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:06.865073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:06.873860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-930cb220-5971-4d55-94a7-11ae02fef6d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1307 microversion: 2.1 time: 0.173523 Apr 05 12:15:06.884820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 544/1041] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:06 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:07.008724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ba58d6a6-a7e2-47be-b86e-93069c225929 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:07.017033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ba58d6a6-a7e2-47be-b86e-93069c225929 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1088 microversion: 2.1 time: 0.164225 Apr 05 12:15:07.017657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 498/1042] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:06 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1088 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:07.229858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:07.230632 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:07.238882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.239503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:07.240463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.241128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:07.308498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lazy-loading 'flavor' on Instance uuid bf7526c1-27ee-4858-bfb2-afe77dedf39b {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:15:07.676212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b772d68-5e47-40f7-969f-8ecef2bd7c82 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 202 len: 0 microversion: 2.20 time: 0.450531 Apr 05 12:15:07.680106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 545/1043] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:07 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:15:07.685508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:07.686206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:07.695330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.695841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:07.696684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.697176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:07.893313 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:07.894180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:07.902497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.903177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:07.904163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:07.904803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:08.129677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:08.176055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:08.181830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:08.183158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a1a29454-94b3-4991-b7ba-fbba789b6251 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.501676 Apr 05 12:15:08.189347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 499/1044] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:07 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:08.195964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:08.196647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:08.219274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:08.219955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:08.220992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:08.222087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:08.343733 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:08.356701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b8bc9f40-564f-4b79-b0e5-9cf916915d15 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.467852 Apr 05 12:15:08.358853 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 546/1045] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:07 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:08.483352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:08.493260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5a902d82-ed03-4b0c-bb67-ef4b4f8fe046 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1204 microversion: 2.1 time: 0.301319 Apr 05 12:15:08.494465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 500/1046] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:08 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1204 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:09.208813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:09.210186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:09.218971 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.220213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.221454 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.222560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.378579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:09.379359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:09.398503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.399338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.400422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.401106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.644224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:09.655562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:09.658611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:09.660610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3351b4a-39e4-4b9b-a73c-1556e6dcaf2d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.456392 Apr 05 12:15:09.672609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 547/1047] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:09 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:09.672609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:09.672609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:09.678735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.679403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.680377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.681119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:09.957253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:09.969066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ea2164e1-a7a6-48e4-8094-8e7c7a877b97 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.595138 Apr 05 12:15:09.970250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 501/1048] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:09 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:09.976568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-cf7fd9e0-a8a8-42b2-8135-713a6d493f26 req-148b8f60-9385-4a30-8623-24ab07a3c418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b09822d-7a64-412e-b682-76883101e238", "tag": "01581f08-eae8-48fc-8341-e867d2a86c52"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:09.979142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:09.979142 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:09.988949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cf7fd9e0-a8a8-42b2-8135-713a6d493f26 req-148b8f60-9385-4a30-8623-24ab07a3c418 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:09.989702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-cf7fd9e0-a8a8-42b2-8135-713a6d493f26 req-148b8f60-9385-4a30-8623-24ab07a3c418 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:10.010902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-cf7fd9e0-a8a8-42b2-8135-713a6d493f26 req-148b8f60-9385-4a30-8623-24ab07a3c418 service nova] Creating event network-changed:01581f08-eae8-48fc-8341-e867d2a86c52 for instance 9b09822d-7a64-412e-b682-76883101e238 on hv-cinder-78476 Apr 05 12:15:10.016596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-cf7fd9e0-a8a8-42b2-8135-713a6d493f26 req-148b8f60-9385-4a30-8623-24ab07a3c418 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044979 Apr 05 12:15:10.017822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 502/1049] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:10.394989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:10.404178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-28644632-a739-4587-9a3e-fecbda02d36d tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.740874 Apr 05 12:15:10.405029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 548/1050] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:09 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:10.681808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:10.682662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:10.691073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:10.691595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:10.692445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:10.692938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:10.988672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:10.989455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:11.013688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:11.014236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:11.015109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:11.015603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:11.336768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:11.363532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:11.367042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:11.368740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:11.369990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b79b3221-fcbb-48f8-a9de-edfc523fa049 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.692736 Apr 05 12:15:11.370874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 503/1051] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:10 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:11.372549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-90ba03dd-a81b-4ce1-80b9-70ad597af309 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.388606 Apr 05 12:15:11.373437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 549/1052] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:10 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:11.376096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-5c5dc45a-f4ec-4e27-9d7d-a4be984b5bab req-50eea928-e48b-40f2-9cdf-6631c5a5075a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:11.378336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:11.378336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:11.388558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5c5dc45a-f4ec-4e27-9d7d-a4be984b5bab req-50eea928-e48b-40f2-9cdf-6631c5a5075a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:11.389035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5c5dc45a-f4ec-4e27-9d7d-a4be984b5bab req-50eea928-e48b-40f2-9cdf-6631c5a5075a service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:11.411652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-5c5dc45a-f4ec-4e27-9d7d-a4be984b5bab req-50eea928-e48b-40f2-9cdf-6631c5a5075a service nova] Creating event network-changed:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:15:11.419348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-5c5dc45a-f4ec-4e27-9d7d-a4be984b5bab req-50eea928-e48b-40f2-9cdf-6631c5a5075a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046923 Apr 05 12:15:11.420223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 504/1053] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:11.423440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:11.423771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:11.435165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:11.435826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:11.436792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:11.437396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:11.814647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:11.823535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f9cb22b3-5128-4e7b-9b13-ea2a4f07688f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.405137 Apr 05 12:15:11.824286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 550/1054] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:11 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:12.399881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:12.400646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:12.407098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:12.407829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:12.408988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.409595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:12.410464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.410934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:12.415941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.416589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:12.417439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.417938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:12.633029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:12.642666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:12.644501 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:12.645719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e6ca550b-d011-4532-8410-46c9accc2b8a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.251037 Apr 05 12:15:12.646361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 505/1055] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:12 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:12.731611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:12.741128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-478a6447-6661-482b-9701-e7140de88b34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.338171 Apr 05 12:15:12.741856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 551/1056] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:12 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:15:12.842017 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:12.842711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:12.851069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.851572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:12.852405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:12.852927 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:13.068723 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:13.077592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f6ff94dc-d3b6-4286-9194-3b5dd8004999 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.239643 Apr 05 12:15:13.078246 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 506/1057] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:12 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:13.665495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:13.666077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:13.673930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:13.674474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:13.675402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:13.675902 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:13.759060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:13.759852 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:13.769045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:13.769584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:13.770467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:13.770968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:13.891406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:13.901665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:13.903602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:13.905006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7098d17a-4e65-46aa-981d-ebac36680ab3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.243651 Apr 05 12:15:13.905603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 552/1058] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:13 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:13.994109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:14.003886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a404e983-9a4e-431d-9849-d3bff735e139 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.248212 Apr 05 12:15:14.004530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 507/1059] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:13 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:15:14.095549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:14.096229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:14.104398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:14.104915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:14.105950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:14.106590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:14.331657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:14.340560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8e03338c-8548-4de4-b160-b39951e3efb7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.249119 Apr 05 12:15:14.341188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 553/1060] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:14 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:14.925141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:14.925871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:14.933695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:14.934234 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:14.935073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:14.935566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:15.021008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:15.021691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:15.029851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:15.030402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:15.031247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:15.031740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:15.156396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:15.167023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:15.168681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:15.169892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6c97587f-22dc-46c8-bcf9-5bc2a836ae2b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.249365 Apr 05 12:15:15.170538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 508/1061] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:14 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:15.248559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:15.257386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fb3f58f4-b25d-4209-880d-6807f9ea0df6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.240432 Apr 05 12:15:15.258041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 554/1062] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:15 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:15.358878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:15.359584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:15.368260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:15.368762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:15.369586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:15.370067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:15.579957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:15.589336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-afaf43f6-b2d5-4096-bbbb-515f5f2aa77b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.234525 Apr 05 12:15:15.589966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 509/1063] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:15 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:16.004603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-993af81b-7f24-495b-bdfd-ffd0843b2129 req-45c57d5b-cea2-4242-8fb3-a624563d4d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b09822d-7a64-412e-b682-76883101e238", "name": "network-vif-plugged", "status": "completed", "tag": "01581f08-eae8-48fc-8341-e867d2a86c52"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:16.006640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:16.006640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:16.016122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-993af81b-7f24-495b-bdfd-ffd0843b2129 req-45c57d5b-cea2-4242-8fb3-a624563d4d3b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.016625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-993af81b-7f24-495b-bdfd-ffd0843b2129 req-45c57d5b-cea2-4242-8fb3-a624563d4d3b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.034529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-993af81b-7f24-495b-bdfd-ffd0843b2129 req-45c57d5b-cea2-4242-8fb3-a624563d4d3b service nova] Creating event network-vif-plugged:01581f08-eae8-48fc-8341-e867d2a86c52 for instance 9b09822d-7a64-412e-b682-76883101e238 on hv-cinder-78476 Apr 05 12:15:16.039663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-993af81b-7f24-495b-bdfd-ffd0843b2129 req-45c57d5b-cea2-4242-8fb3-a624563d4d3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039320 Apr 05 12:15:16.040307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 555/1064] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:16.189606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:16.190347 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:16.198447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.198965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.199812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.200306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.277082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:16.277862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:16.287179 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.287691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.288550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.289177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.426424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:16.436068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:16.437748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:16.438993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e6df0504-c836-42cf-bd27-4b6c0c2bf542 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.253581 Apr 05 12:15:16.439623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 510/1065] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:16 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:16.512444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:16.521991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5f9daaaa-02b4-40a4-bc7d-060c63f6d917 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1363 microversion: 2.1 time: 0.249857 Apr 05 12:15:16.522645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 556/1066] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:16 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:16.607685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:16.608358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:16.616178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.616688 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.617527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:16.618022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:16.832755 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:16.841468 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b6babd5-93b5-4294-82c7-f3d907d79bb2 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.237925 Apr 05 12:15:16.842100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 511/1067] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:16 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:17.459527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:17.460126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:17.468520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.469023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.469866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.470379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.540645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:17.541353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:17.549232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.550388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.551308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.551796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.772037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:17.781735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c4fbd70d-2e6c-4932-a214-874c1294e8e8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1550 microversion: 2.1 time: 0.244956 Apr 05 12:15:17.782426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 512/1068] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:17 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1550 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:17.801403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:17.802085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:17.810484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.811105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.812047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.812619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.933029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:17.942598 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:17.944282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:17.945505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-13f236b5-5625-4f77-8614-2b9cbecef404 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.490246 Apr 05 12:15:17.946163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 557/1069] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:17 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:17.950767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:17.951440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:17.959966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.960512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.961353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:17.961837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:17.976754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-96edd5b1-4a52-43bd-a1b9-c9997ca53a69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179905 Apr 05 12:15:17.977499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 513/1070] 10.222.0.36 () {58 vars in 1265 bytes} [Mon Apr 5 12:15:17 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:15:18.175861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:18.184767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dc5e11ef-555e-4b16-afb9-c38266a991f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.237543 Apr 05 12:15:18.185602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 558/1071] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:17 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:18.965192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:18.965941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:18.974436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:18.974886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:18.975714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:18.976216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.202630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:19.203305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:19.211699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:19.212202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.213026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:19.213509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.438744 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:19.449165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-afacd621-0630-48d2-8bc3-9977fd91e73c tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.250460 Apr 05 12:15:19.450053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 559/1072] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:19 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:19.618262 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:19.627570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:19.629237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:19.630477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-21c58f1a-7273-4f11-b8ef-97e27e6e66fd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.669345 Apr 05 12:15:19.631294 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 514/1073] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:18 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:19.897092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:19.898365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:19.908068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-ffcad175-9eb3-43ca-892a-fe5874362bd0 req-e8a1510c-3d2a-4755-80c0-500f346870a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b09822d-7a64-412e-b682-76883101e238", "tag": "01581f08-eae8-48fc-8341-e867d2a86c52"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:19.910151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:19.910151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:19.918627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:19.919308 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.919549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-ffcad175-9eb3-43ca-892a-fe5874362bd0 req-e8a1510c-3d2a-4755-80c0-500f346870a1 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:19.920052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-ffcad175-9eb3-43ca-892a-fe5874362bd0 req-e8a1510c-3d2a-4755-80c0-500f346870a1 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.920500 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:19.921109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:19.941919 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-ffcad175-9eb3-43ca-892a-fe5874362bd0 req-e8a1510c-3d2a-4755-80c0-500f346870a1 service nova] Creating event network-changed:01581f08-eae8-48fc-8341-e867d2a86c52 for instance 9b09822d-7a64-412e-b682-76883101e238 on hv-cinder-78476 Apr 05 12:15:19.947236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-ffcad175-9eb3-43ca-892a-fe5874362bd0 req-e8a1510c-3d2a-4755-80c0-500f346870a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043035 Apr 05 12:15:19.947899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 515/1074] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:20.023430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-342a0d87-fa46-47da-b4f5-5dca5acc216e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.131063 Apr 05 12:15:20.024431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 560/1075] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:19 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:20.469687 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:20.470512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:20.478797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:20.479312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:20.480156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:20.480648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:20.649984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:20.650790 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:20.664621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:20.665145 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:20.666399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:20.667058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:20.716898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:20.727506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-30016fce-6a7c-417b-b01f-2bf8d934fb3e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.262922 Apr 05 12:15:20.729165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 516/1076] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:20 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:20.936433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:20.947715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:20.949466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:20.950791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-73a465be-bc9d-4559-9a72-ea891424458f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.305364 Apr 05 12:15:20.951667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 561/1077] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:20 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:21.036829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:21.037968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:21.046312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.046826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:21.047686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.048178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:21.153274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-85caa2d2-d210-4c17-8882-9a7d7eb23450 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.121093 Apr 05 12:15:21.154203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 517/1078] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:21 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:21.746405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:21.747085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:21.756077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.756579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:21.757411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.757892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:21.972436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:21.973321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:21.974104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:21.981766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a56565f2-57ec-41e4-8790-31e425a35598 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.239370 Apr 05 12:15:21.982702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 562/1079] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:21 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:21.982843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.983094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:21.984025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:21.984519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:22.165296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:22.167960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:22.177283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:22.177796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:22.178891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:22.179386 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:22.209382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:22.219462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:22.222060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:22.223337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e71d6b6a-65e0-419c-b35e-7875ad856fb2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.254510 Apr 05 12:15:22.224190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 518/1080] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:21 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:22.278157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6582c9d8-50ef-4071-ac19-3aeb2aac2867 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.116982 Apr 05 12:15:22.279063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 563/1081] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:22 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 12:15:22.999508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:23.000177 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:23.008309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.008811 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.009633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.010117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.225328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:23.234010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-266f663d-a6ca-4031-9dcf-89d231635862 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.238475 Apr 05 12:15:23.234661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 519/1082] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:22 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:23.243856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:23.244633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:23.253819 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.254339 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.255187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.255680 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.289351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:23.290456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:23.298165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.298671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.299503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:23.299993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:23.472021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:23.481418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:23.483119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:23.484325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2abdd0d4-9709-4e0e-93ab-fc2c001b0ecd tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.245126 Apr 05 12:15:23.484969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 564/1083] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:23 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:23.945717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-23747eac-f69c-46db-b1c4-2ec23f756133 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.660135 Apr 05 12:15:23.946479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 520/1084] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:23 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 05 12:15:24.041007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-29e2e287-bf9a-49ef-a433-098971084725 req-5bb05650-18ca-442a-b33b-12a9fb9cf6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "name": "network-vif-plugged", "status": "completed", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:24.043083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:24.043083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:24.053502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-29e2e287-bf9a-49ef-a433-098971084725 req-5bb05650-18ca-442a-b33b-12a9fb9cf6c6 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.054252 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-29e2e287-bf9a-49ef-a433-098971084725 req-5bb05650-18ca-442a-b33b-12a9fb9cf6c6 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.072018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-29e2e287-bf9a-49ef-a433-098971084725 req-5bb05650-18ca-442a-b33b-12a9fb9cf6c6 service nova] Creating event network-vif-plugged:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:15:24.077138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-29e2e287-bf9a-49ef-a433-098971084725 req-5bb05650-18ca-442a-b33b-12a9fb9cf6c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040157 Apr 05 12:15:24.077804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 565/1085] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:24.253269 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:24.254076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:24.262893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.263406 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.264258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.264754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.483794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:24.493237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3bff1ded-9176-409f-a339-c3ff2eaba846 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.245252 Apr 05 12:15:24.493871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 521/1086] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:24 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:24.505507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:24.506314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:24.514312 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.514829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.515670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.516170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.730847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:24.740267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:24.741940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:24.743192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-be2f71e9-6278-403d-b843-4bd79c1d9417 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1746 microversion: 2.20 time: 0.243368 Apr 05 12:15:24.743815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 566/1087] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:24 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1746 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:24.957923 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:24.958973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:24.967652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.968158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:24.968986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:24.969474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:25.100377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e370c534-14ff-449f-ad66-98d63f7d62d8 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.146915 Apr 05 12:15:25.101055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 522/1088] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:24 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:25.512270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:25.512922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:25.521291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:25.521799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:25.522658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:25.523150 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:25.744961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:25.753824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1c1dc70b-7020-47e0-8206-3732cf9556f4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1259 microversion: 2.1 time: 0.246480 Apr 05 12:15:25.754476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 567/1089] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:25 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:25.764165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:25.764883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:25.773576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:25.774086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:25.774969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:25.775464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:25.991860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:26.001478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:26.003311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:26.004530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-905c15ac-3a27-4e20-b9f6-62021ad0388d tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1746 microversion: 2.20 time: 0.245103 Apr 05 12:15:26.005156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 523/1090] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:25 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:26.111546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:26.113741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:26.122015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:26.122594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:26.123594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:26.124092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:26.225565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-51bd292d-0733-44df-8e56-9de5e9bfdf69 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.118366 Apr 05 12:15:26.226273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 568/1091] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:26 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:26.771511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:26.772193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:26.780692 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:26.781204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:26.782033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:26.782553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:26.994920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:27.004575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3e2ade89-b519-4fcc-be24-278c718c259a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1442 microversion: 2.1 time: 0.237116 Apr 05 12:15:27.005201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 524/1092] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:26 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1442 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:27.022550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:27.023101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:27.023260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:27.023768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:27.031621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.031900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.032130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.032405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.032965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.033238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.033456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.034307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.248182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:27.251036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:27.257914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:27.259605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:27.260033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-04908bd1-9300-481b-bbcc-e25935a9c148 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1442 microversion: 2.1 time: 0.242202 Apr 05 12:15:27.260665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 569/1093] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:15:27 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1442 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:27.260808 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d214aa6-50b4-4ba1-bc39-6c431c22119c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1746 microversion: 2.20 time: 0.241534 Apr 05 12:15:27.272682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 525/1094] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:27 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1746 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:27.272999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:27.272999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:27.275610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.276113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.277211 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:27.277702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:27.379864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b63aea60-cbf1-40b4-92d5-9ecdbc55b6bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.117839 Apr 05 12:15:27.380653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 570/1095] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:27 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:28.079643 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-1331386c-bafe-44e8-87f6-153199ea6647 req-fe01fb3c-3968-48f7-bf70-ec06e172e842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "name": "network-vif-plugged", "status": "completed", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:28.082450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:28.082450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:28.091941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1331386c-bafe-44e8-87f6-153199ea6647 req-fe01fb3c-3968-48f7-bf70-ec06e172e842 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:28.092677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-1331386c-bafe-44e8-87f6-153199ea6647 req-fe01fb3c-3968-48f7-bf70-ec06e172e842 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:28.113959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-1331386c-bafe-44e8-87f6-153199ea6647 req-fe01fb3c-3968-48f7-bf70-ec06e172e842 service nova] Creating event network-vif-plugged:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:15:28.120160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-1331386c-bafe-44e8-87f6-153199ea6647 req-fe01fb3c-3968-48f7-bf70-ec06e172e842 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043807 Apr 05 12:15:28.121020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 526/1096] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:28.282106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:28.283392 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:28.293081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:28.293887 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:28.294991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:28.295705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:28.392343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:28.394526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:28.403611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:28.404430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:28.405730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:28.406476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:28.513638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9a88dc05-8d23-48f6-91bb-24188fd9f90f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.125590 Apr 05 12:15:28.514485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 527/1097] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:28 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:28.684906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:28.695344 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:28.697015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:28.698267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8ff52df4-2ae4-4abf-b509-59b7a6676fc9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1746 microversion: 2.20 time: 0.421104 Apr 05 12:15:28.698889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 571/1098] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:28 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1746 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:29.526809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:29.527952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:29.537395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:29.537904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:29.538782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:29.539337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:29.641524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-49c1977d-a951-48aa-a1fb-a43ff6a4045d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 14 microversion: 2.1 time: 0.119616 Apr 05 12:15:29.645464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 528/1099] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:29 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 05 12:15:29.717645 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:29.718391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:29.732352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:29.732858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:29.733704 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:29.734208 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:29.967288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:29.979276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:29.981535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:29.983108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-63ac20ec-69f6-4ab0-bfd0-e11fc92c2e31 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.269455 Apr 05 12:15:29.984103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 572/1100] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:29 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:30.508227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-b306cee4-ecec-4dc6-873e-a1f5d94e5188 req-d4750628-977b-44a2-ac45-c07b16328217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:30.513641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:30.513641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:30.541046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-b306cee4-ecec-4dc6-873e-a1f5d94e5188 req-d4750628-977b-44a2-ac45-c07b16328217 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:30.542413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-b306cee4-ecec-4dc6-873e-a1f5d94e5188 req-d4750628-977b-44a2-ac45-c07b16328217 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:30.563512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-b306cee4-ecec-4dc6-873e-a1f5d94e5188 req-d4750628-977b-44a2-ac45-c07b16328217 service nova] Creating event network-changed:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:15:30.569785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-b306cee4-ecec-4dc6-873e-a1f5d94e5188 req-d4750628-977b-44a2-ac45-c07b16328217 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065812 Apr 05 12:15:30.571153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 529/1101] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:15:30.654850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:30.656599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:30.666180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:30.666955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:30.668033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:30.668730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:30.798527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cb2b5d35-a451-423d-81e6-c909e0c3bc66 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 6695 microversion: 2.1 time: 0.148972 Apr 05 12:15:30.800365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 573/1102] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:30 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 6695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:15:31.007164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:31.008219 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:31.028949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:31.030712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:31.032848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:31.035728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:31.356545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:31.370477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:31.372165 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:31.373414 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1bbccc08-bd1e-4c86-85b4-64c83d86a3d3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.372762 Apr 05 12:15:31.374305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 530/1103] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:30 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:31.811993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:31.815187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:31.824534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:31.825171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:31.826250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:31.826898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:31.942773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-65784b4b-567a-4998-927e-eba68570461d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 15025 microversion: 2.1 time: 0.134161 Apr 05 12:15:31.944891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 574/1104] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:31 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 15025 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:32.392225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:32.393596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:32.405992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:32.406642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:32.408007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:32.409065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:32.659489 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:32.675231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:32.676931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:32.678169 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a0058ecf-5c1b-43a6-8e95-c484e4b8267e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.289999 Apr 05 12:15:32.678985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 531/1105] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:32 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:32.956762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:32.957913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:32.967791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:32.968315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:32.969387 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:32.969886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:33.084595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6c54d27f-c611-4ef8-8aa4-020ad257df8f tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 18356 microversion: 2.1 time: 0.132540 Apr 05 12:15:33.086088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 575/1106] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:32 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 18356 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:33.698530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:33.699172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:33.707403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:33.707904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:33.708773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:33.709296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:33.933918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:33.944955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:33.947097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:33.947932 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-638c18cd-a990-4543-9bb0-d66055433b93 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.253616 Apr 05 12:15:33.949857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 532/1107] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:33 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:34.099197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:34.100345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:34.129943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:34.130948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:34.133074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:34.133774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:34.265542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-19b602f6-74bf-43b0-a602-d399a9408fc7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 19342 microversion: 2.1 time: 0.170965 Apr 05 12:15:34.266480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 576/1108] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:34 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 19342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:34.968505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:34.969233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:34.978254 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:34.978943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:34.979877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:34.980437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:35.206551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:35.216730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:35.218682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:35.219930 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-481f6f2a-695a-44a3-9209-49209bcbd0ff tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.255553 Apr 05 12:15:35.220662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 533/1109] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:34 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:35.279663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:35.280972 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:35.290010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:35.290821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:35.291518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:35.292011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:35.416548 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e59dfbc3-1479-451d-8f4a-398f1b8755a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 22168 microversion: 2.1 time: 0.141624 Apr 05 12:15:35.417305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 577/1110] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:35 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 22168 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:36.243590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:36.244281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:36.254654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:36.255170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:36.256447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:36.256639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:36.429870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:36.431019 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:36.443154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:36.443667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:36.444526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:36.445023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:36.494270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:36.506422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:36.508206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:36.510020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-db8b1bca-fb4d-42db-99b7-d6c247fd4124 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.273952 Apr 05 12:15:36.511004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 534/1111] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:36 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:36.566025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-457340ed-3d64-41c4-88e3-be4283682e6a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 23658 microversion: 2.1 time: 0.139869 Apr 05 12:15:36.566797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 578/1112] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:36 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 23658 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:37.533330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:37.535676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:37.542866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:37.543377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:37.544251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:37.544712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:37.583345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:37.584517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:37.611069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:37.611795 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:37.612665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:37.613153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:37.742457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b76f33fb-c8ff-4db3-8195-ac0ba5b68d46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 24948 microversion: 2.1 time: 0.165430 Apr 05 12:15:37.749726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 579/1113] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:37 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 24948 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:37.800047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:37.812379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:37.814055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:37.815867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4fdf4781-7a54-47f4-a476-f7b505c0b8d7 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.286631 Apr 05 12:15:37.818779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 535/1114] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:37 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:38.755244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:38.756484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:38.766337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:38.767508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:38.768609 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:38.769305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:38.835220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:38.835898 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:38.845282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:38.845955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:38.846936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:38.847534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:38.882099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c014b2a6-6fc2-4b02-b12d-ff8c6ed9ca5d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 26275 microversion: 2.1 time: 0.131965 Apr 05 12:15:38.883708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 580/1115] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:38 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 26275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:39.090485 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:39.103105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:39.105102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:39.106729 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-52ac6c4e-3ad2-43f4-9277-2809ee39b647 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.275609 Apr 05 12:15:39.107556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 536/1116] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:38 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:39.895542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:39.896726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:39.905565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:39.906076 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:39.906935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:39.907423 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:40.116584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3e7ad8dd-3b03-436d-b721-d2806a66b388 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 27320 microversion: 2.1 time: 0.225382 Apr 05 12:15:40.117664 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 581/1117] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:39 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 27320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:40.128056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:40.128726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:40.136530 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:40.137036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:40.137863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:40.138399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:40.352321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:40.362399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:40.364285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:40.365796 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5d10df3a-8502-429b-bc66-5835e5dfe193 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1741 microversion: 2.20 time: 0.241784 Apr 05 12:15:40.366481 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 537/1118] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:40 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:41.130436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:41.131539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:41.140498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:41.141022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:41.141882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:41.142403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:41.251382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3877138-c907-4118-bc39-287461b5cf0d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 27668 microversion: 2.1 time: 0.126152 Apr 05 12:15:41.252160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 582/1119] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:41 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 27668 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:15:41.385286 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:41.385921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:41.394503 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:41.395005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:41.395844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:41.396330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:41.605233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:41.615382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:41.617067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:41.618416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7d763c59-3cbb-4ad8-ab26-d4e595ffb966 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1723 microversion: 2.20 time: 0.237275 Apr 05 12:15:41.619048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 538/1120] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:41 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:42.265895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:42.267054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:42.275492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:42.275994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:42.277070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:42.277555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:42.379240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d4d59f4a-5e1e-4a8b-9574-b6b2e24712a7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28027 microversion: 2.1 time: 0.117618 Apr 05 12:15:42.379929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 583/1121] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:42 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28027 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:42.639048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:42.639711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:42.648218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:42.648778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:42.649647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:42.650153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:42.865538 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:42.874899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:42.876556 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:42.878476 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-11eb0248-bbba-4d42-99cf-e59df01293a9 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1723 microversion: 2.20 time: 0.243467 Apr 05 12:15:42.879088 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 539/1122] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:42 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:43.392225 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:43.393396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:43.403067 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:43.403577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:43.404518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:43.404969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:43.521784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-194f7ca8-3b2c-4cb9-9a2a-daf4ad724a0e tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28213 microversion: 2.1 time: 0.133814 Apr 05 12:15:43.522570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 584/1123] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:43 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:43.898367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:43.899282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:43.907447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:43.907989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:43.909855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:43.910359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.061711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-0a310032-cea6-414e-a9d6-28a645c53785 req-89488a4a-842a-4de7-9bec-41b43dd1c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "name": "network-vif-unplugged", "status": "completed", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:44.063393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:15:44.063393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:15:44.073340 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a310032-cea6-414e-a9d6-28a645c53785 req-89488a4a-842a-4de7-9bec-41b43dd1c3a3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.073858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a310032-cea6-414e-a9d6-28a645c53785 req-89488a4a-842a-4de7-9bec-41b43dd1c3a3 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.091815 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.compute.server_external_events [req-0a310032-cea6-414e-a9d6-28a645c53785 req-89488a4a-842a-4de7-9bec-41b43dd1c3a3 service nova] Unable to find a host for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b. Dropping event network-vif-unplugged {{(pid=98312) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 05 12:15:44.092768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-0a310032-cea6-414e-a9d6-28a645c53785 req-89488a4a-842a-4de7-9bec-41b43dd1c3a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036033 Apr 05 12:15:44.093572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 585/1124] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 05 12:15:44.128200 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:44.139237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:44.141010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:44.142148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1572687b-e93e-49af-afe8-b9ac9b33a83f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1666 microversion: 2.20 time: 0.248234 Apr 05 12:15:44.143495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 540/1125] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:43 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1666 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:44.163390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68cc9523-9927-4595-b212-0e8cf85748f2"}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:44.164697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:44.172713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.173212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.174447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.174933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.534304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:44.535444 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:44.543362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.543878 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.544725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.545220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.606850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e0dec0fc-f92e-4871-ad2b-e4efe0981223 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.448578 Apr 05 12:15:44.607524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 586/1126] 10.222.0.36 () {62 vars in 1354 bytes} [Mon Apr 5 12:15:44 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-volume_attachments => generated 188 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:44.653637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c3d92f7-d5c1-4642-a07d-98a715fba220 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28213 microversion: 2.1 time: 0.123736 Apr 05 12:15:44.654622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 541/1127] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:44 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:15:44.722326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:44.722885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:44.731391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.731908 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:44.732792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:44.733288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.167839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1c093dc7-b209-490e-9750-ee9962741e12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-volume_attachments/68cc9523-9927-4595-b212-0e8cf85748f2" status: 202 len: 0 microversion: 2.20 time: 0.449738 Apr 05 12:15:45.168495 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 587/1128] 10.222.0.36 () {60 vars in 1447 bytes} [Mon Apr 5 12:15:44 2021] DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/os-volume_attachments/68cc9523-9927-4595-b212-0e8cf85748f2 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:15:45.271646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:45.272368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:45.281194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.281697 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.282546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.283033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.433955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-62775cb2-8609-4bce-b8b1-8ce564cf8e41 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action" status: 202 len: 0 microversion: 2.20 time: 0.166871 Apr 05 12:15:45.434647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 542/1129] 10.222.0.36 () {62 vars in 1309 bytes} [Mon Apr 5 12:15:45 2021] POST /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:15:45.444023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:45.444792 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:45.453367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.453875 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.454748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.455236 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.665676 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:45.667397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:45.676782 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.677305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.678237 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:45.678734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:45.679562 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:45.691250 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:45.693326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:45.694584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9b98434b-e08f-4fea-8f91-8d1617f4e379 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1674 microversion: 2.20 time: 0.255304 Apr 05 12:15:45.695202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 588/1130] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:45 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:45.785656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4e65b5b-49e9-4fe8-adea-c1044e9f373b tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28213 microversion: 2.1 time: 0.123754 Apr 05 12:15:45.786411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 543/1131] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:45 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:46.714635 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:46.715359 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:46.723750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:46.724305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:46.725251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:46.725777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:46.798154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:46.799298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:46.807738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:46.808249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:46.809100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:46.809592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:46.907330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cc67f6eb-68cc-4fec-a5e4-1b3a11596b90 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28213 microversion: 2.1 time: 0.113547 Apr 05 12:15:46.908049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 544/1132] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:46 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:15:47.053522 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:47.063108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:47.064774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:47.066330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e78b5eb7-3571-41f5-b5e6-806623c05884 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1676 microversion: 2.20 time: 0.356079 Apr 05 12:15:47.066956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 589/1133] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:46 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1676 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:47.921621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:47.922803 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:47.932498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:47.932893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:47.933731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:47.934271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:48.043199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d9d72a33-f5e2-49b1-a611-3cbc9239e8ba tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28213 microversion: 2.1 time: 0.125332 Apr 05 12:15:48.043410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 545/1134] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:47 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:15:48.087412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:48.088297 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:48.098532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:48.099404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:48.100334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:48.100862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:48.383267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:48.392834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:48.395113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:48.396329 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2ccb05c7-985c-4342-96a3-294fbb82dd1e tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.315110 Apr 05 12:15:48.396956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 590/1135] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:48 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:49.056115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:15:49.057290 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:49.066636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:49.067292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:49.068109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:49.068600 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:49.416702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:49.417462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:49.425602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:49.426106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:49.426973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:49.427456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:49.652750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:49.663987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:49.665677 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:49.667013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-12150e9f-3e3a-48e7-9837-5e2ec78f60cb tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.254503 Apr 05 12:15:49.667791 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 591/1136] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:49 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:50.687491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:50.688304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:50.696563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:50.697064 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:50.697912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:50.698550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:50.921068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:50.931398 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:50.933077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:50.934362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b1622ae-df76-4ccd-b823-f8433e68e79f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.251482 Apr 05 12:15:50.935291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 592/1137] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:50 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:51.954033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:51.954988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:51.963315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:51.963961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:51.965077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:51.965659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:52.325535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:52.335904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:52.337626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:52.338869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2e6edc07-86ce-4e41-8d4b-4fba9340326c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.389069 Apr 05 12:15:52.339696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 593/1138] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:51 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:53.359207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:53.360023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:53.368906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:53.369418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:53.370445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:53.370938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:53.594980 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:53.604402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:53.606384 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:53.607724 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f90c3d92-e4a2-4e98-aa88-6a45e7840092 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.252635 Apr 05 12:15:53.608370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 594/1139] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:53 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:54.627113 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:54.627826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:54.635889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:54.636400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:54.637256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:54.637787 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:54.858824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:54.869372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:54.871183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:54.872390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d887f2d2-60a0-4886-84de-208480ece8ab tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.249361 Apr 05 12:15:54.873273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 595/1140] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:54 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:15:55.892842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:55.893634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:55.902480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:55.902982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:55.903823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:55.904303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:56.128639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:56.138544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:56.140327 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:56.141533 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5930587f-2609-41b9-8b60-2370c005e6c8 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.252937 Apr 05 12:15:56.142151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 596/1141] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:55 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:57.163144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:57.163822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:57.172010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:57.172517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:57.173375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:57.173871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:57.393399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:57.403433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:57.405084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:57.406311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f53a2282-97e4-4d0e-bdeb-7ba3e5ac430c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.247761 Apr 05 12:15:57.406914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 597/1142] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:57 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:58.426393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:58.426987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:58.434883 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:58.435385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:58.436206 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:58.436690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:58.660151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:58.670144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:58.671817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:58.673047 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4baf9cf-e00a-4b4c-a10b-841c1b1ef59c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.250957 Apr 05 12:15:58.673671 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 598/1143] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:58 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:15:59.692136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:15:59.692809 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:15:59.700633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:59.701140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:59.701979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:15:59.702490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:15:59.927040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:59.936437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:59.938469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:15:59.939690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5cd41988-8072-4588-a26a-899fd1d57534 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.251796 Apr 05 12:15:59.940350 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 599/1144] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:15:59 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:16:00.960415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:00.961163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:00.969741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:00.970337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:00.971149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:00.971999 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:01.189867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:01.199258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:01.200926 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:01.202151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c5a5b57-0d46-4507-b9ec-d72f68a750e3 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.246591 Apr 05 12:16:01.202771 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 600/1145] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:00 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:16:02.221429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:02.222204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:02.230029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:02.230601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:02.231441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:02.231935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:02.446338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:02.455780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:02.457628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:02.458881 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-99e8da05-eb2c-4979-b22f-fdbcc0844d8f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.241535 Apr 05 12:16:02.459497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 601/1146] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:02 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:16:03.478464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:03.479093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:03.487068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:03.487732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:03.488572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:03.489061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:03.703008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:03.712960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:03.714684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:03.715874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8338c3ce-4008-47eb-8406-f209607a2b5a tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.241740 Apr 05 12:16:03.716483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 602/1147] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:03 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:16:04.161770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5aa96ef8-875c-4355-ba51-3312b9c46a9d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 15.109909 Apr 05 12:16:04.162848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 546/1148] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:15:49 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 15112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:04.735378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:04.736081 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:04.743975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:04.744483 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:04.745309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:04.745797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:04.952498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:04.962924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:04.964607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:04.965825 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-280ffbac-eac6-40ee-844e-e09e2422eb6b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.234690 Apr 05 12:16:04.966472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 603/1149] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:04 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:05.175173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:05.176299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:05.185422 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:05.185929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:05.186785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:05.187271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:05.282317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-78b62a13-f4b5-40e1-a306-4726974018fe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.111706 Apr 05 12:16:05.282988 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 547/1150] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:05 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:05.985307 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:05.986028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:05.994565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:05.995074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:05.995950 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:05.996445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:06.210705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:06.220183 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:06.222619 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:06.223820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1d2ff963-6d07-4cd6-a53d-e7144dcf8d23 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.242668 Apr 05 12:16:06.224433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 604/1151] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:05 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:06.295322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:06.296465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:06.305242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:06.305754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:06.306626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:06.307120 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:06.436395 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-57d78dfd-22bc-47e8-b27c-8e2f05a2e103 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.145455 Apr 05 12:16:06.437071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 548/1152] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:06 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:07.244338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:07.245010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:07.252827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:07.253332 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:07.254188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:07.254684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:07.450271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:07.451421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:07.460023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:07.460529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:07.461375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:07.461658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:07.461868 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:07.471625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:07.473285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:07.474564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c07f8745-b0c6-46c2-b941-7d62bf25dd3f tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.234222 Apr 05 12:16:07.475176 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 605/1153] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:07 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:07.577212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8f065603-1353-40d7-b97a-f0cdbcefed34 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.131297 Apr 05 12:16:07.577814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 549/1154] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:07 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:08.493666 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:08.494368 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:08.502033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:08.503115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:08.504134 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:08.504566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:08.590154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:08.601706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:08.610705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:08.611223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:08.612702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:08.613193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:08.715323 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f070f594-0f31-4b2b-8be6-eed8843151a9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.129626 Apr 05 12:16:08.716696 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 550/1155] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:08 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:08.722551 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:08.732232 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:08.733949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:08.735355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b2cdebc-5460-40c5-b7f4-d67e24c4c498 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.245771 Apr 05 12:16:08.735966 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 606/1156] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:08 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:09.729051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:09.730203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:09.739273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:09.739780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:09.740613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:09.741103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:09.755888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:09.756560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:09.764508 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:09.765041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:09.765848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:09.766367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:09.846367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9d6e4b1f-8324-4400-9fdf-90857ba04441 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.121648 Apr 05 12:16:09.847090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 551/1157] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:09 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:09.982101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:09.991596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:09.993248 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:09.994463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6a9d0e04-7e5b-43c1-9283-dce18b88b3f0 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.243543 Apr 05 12:16:09.995074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 607/1158] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:09 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 05 12:16:10.251005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-24ff2576-5ecb-4007-a82d-7c74501ca474 req-1a19ebfd-c14d-4496-839b-5031c967f52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "name": "network-vif-plugged", "status": "completed", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:10.252694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:16:10.252694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:16:10.262501 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-24ff2576-5ecb-4007-a82d-7c74501ca474 req-1a19ebfd-c14d-4496-839b-5031c967f52c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:10.263000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-24ff2576-5ecb-4007-a82d-7c74501ca474 req-1a19ebfd-c14d-4496-839b-5031c967f52c service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:10.280352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-24ff2576-5ecb-4007-a82d-7c74501ca474 req-1a19ebfd-c14d-4496-839b-5031c967f52c service nova] Creating event network-vif-plugged:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:16:10.286952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-24ff2576-5ecb-4007-a82d-7c74501ca474 req-1a19ebfd-c14d-4496-839b-5031c967f52c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Apr 05 12:16:10.288090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 552/1159] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:16:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:10.859455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:10.860760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:10.869343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:10.869851 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:10.870747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:10.871244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:10.981147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8c471772-241c-4c9e-ad78-764bd5555527 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.125635 Apr 05 12:16:10.981888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 608/1160] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:10 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:11.014341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:11.015204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:11.023424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:11.023974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:11.024810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:11.025301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:11.239838 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:11.249504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:11.251258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:11.252570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-878e4489-6696-4ec4-95bb-ba686ea91fe1 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.242921 Apr 05 12:16:11.253233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 553/1161] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:11 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:11.995002 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:11.996293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:12.005728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:12.006404 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:12.007338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:12.008089 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:12.105079 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-78842b83-9696-4fbc-8adc-6db27f4aa7dc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.115068 Apr 05 12:16:12.106801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 609/1162] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:11 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:12.271872 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:12.272547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:12.281189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:12.281694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:12.282572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:12.283058 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:12.504721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:12.514345 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:12.516006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:12.517217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b1e9cf50-bf62-43fa-a6c5-cea95015d943 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1732 microversion: 2.20 time: 0.249605 Apr 05 12:16:12.517834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 554/1163] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:12 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:13.118828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:13.119969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:13.128448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:13.129462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:13.130319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:13.130813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:13.234954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0f4a8b7d-3a61-424c-b0c6-6788f39c238c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.120463 Apr 05 12:16:13.235629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 610/1164] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:13 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:13.537615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:13.538325 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:13.546052 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:13.546640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:13.547460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:13.547955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:13.818856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:13.828400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:13.830055 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:13.831302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c2f8aa69-07f2-4fc5-83a7-da76538c8a94 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1719 microversion: 2.20 time: 0.297977 Apr 05 12:16:13.832185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 555/1165] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:16:13 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1719 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:16:14.247925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:14.249061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:14.257603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:14.258114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:14.258992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:14.259487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:14.362424 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-27fd88dd-10d3-4ba5-9b67-1e364a81f5f9 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.118789 Apr 05 12:16:14.363111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 611/1166] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:14 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:15.374961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:15.376003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:15.384979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:15.385490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:15.386351 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:15.386846 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:15.483983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-42fc2af8-c6fb-496b-a9e6-7d2cc16d9edf tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.112913 Apr 05 12:16:15.484674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 556/1167] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:15 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:16.497014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:16.498168 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:16.506502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:16.507000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:16.507829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:16.508315 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:16.527634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:16:16.531968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:16:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action (ip 10.222.0.36) !!! Apr 05 12:16:16.616799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a5171e4d-e3e5-41a3-9df3-b616e3ca4be1 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.124038 Apr 05 12:16:16.617475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 612/1168] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:16 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:17.629114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:17.630890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:17.639378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:17.639888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:17.640714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:17.641202 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:17.754741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c82d2818-4cd1-421f-ba99-944851f166e7 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.130035 Apr 05 12:16:17.756043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 557/1169] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:17 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:18.768552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:18.769705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:18.779115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:18.779686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:18.780559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:18.781061 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:18.890967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d5cbc490-32f2-4294-8ba5-1a2e542b6bb0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.126800 Apr 05 12:16:18.891638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 613/1170] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:18 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:19.904239 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:19.905814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:19.915569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:19.916072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:19.916899 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:19.917380 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:20.024734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2a07de3d-3327-40dc-b789-70294b01a060 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.125098 Apr 05 12:16:20.025403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 558/1171] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:19 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:21.038576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:21.039708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:21.048107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:21.048611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:21.049433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:21.049921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:21.148718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5774f24f-aada-4144-96d6-ad39002d7476 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.115053 Apr 05 12:16:21.149421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 614/1172] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:21 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:22.162494 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:22.163686 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:22.172466 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:22.172981 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:22.173816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:22.174353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:22.280863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f50a94c6-1f66-4aa1-acea-4a4288dd8361 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.123006 Apr 05 12:16:22.281818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 559/1173] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:22 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:23.294371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:23.295510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:23.304247 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:23.304765 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:23.305604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:23.306097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:23.411039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1b06f1c2-4414-47b1-b2e7-c9d193ec57ea tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.120965 Apr 05 12:16:23.412220 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 615/1174] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:23 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:24.424370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:24.425506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:24.434331 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:24.434847 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:24.435685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:24.436178 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:24.536725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-91927451-f94d-44b6-a407-90760e6159fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.116575 Apr 05 12:16:24.537348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 560/1175] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:24 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:25.549431 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:25.550590 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:25.559136 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:25.559637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:25.560486 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:25.561090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:28.287721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b5b2cedc-1e3f-414e-b7ea-3f5d51001369 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 2.742525 Apr 05 12:16:28.289189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 616/1176] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:25 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:29.306745 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:29.307897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:29.316699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:29.317213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:29.318163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:29.318657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:29.422102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1d7eaa9d-26e3-4ae0-84f8-739a44d9bf59 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.120230 Apr 05 12:16:29.423672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 561/1177] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:29 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:30.435469 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:30.436545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:30.445711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:30.446241 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:30.447090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:30.447593 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:30.556589 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cb8249cc-0afa-4812-ae2c-cd9fa92b381d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.125585 Apr 05 12:16:30.557274 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 617/1178] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:30 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:31.569658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:31.570854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:31.579484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:31.579991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:31.580816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:31.581302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:31.688212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0b52b14e-2c1f-4733-aef9-5b0c9cb9074c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.122957 Apr 05 12:16:31.688896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 562/1179] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:31 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:32.701306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:32.702462 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:32.713153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:32.713670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:32.715614 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:32.716125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:32.943321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-439541ca-13cc-4034-89d9-7c0413a475a2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.246239 Apr 05 12:16:32.944073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 618/1180] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:32 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:33.957272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:33.958646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:33.967302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:33.967822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:33.968663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:33.969160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:34.073656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-844ec839-44aa-4fc8-82d2-b1362a4c4293 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.121259 Apr 05 12:16:34.074362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 563/1181] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:33 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:34.489890 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-841160025", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-9640565", "security_groups": [{"name": "tempest-secgroup-smoke-398527571"}], "block_device_mapping_v2": [{"uuid": "e553894f-5b54-4df0-b5a3-c916a7713378", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e4dca9-c22e-4b2f-b50e-39573f778a69"}]}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:34.710358 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.network.neutron [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] validate_networks() for [('a3e4dca9-c22e-4b2f-b50e-39573f778a69', None, None, None)] {{(pid=98312) validate_networks /opt/stack/nova/nova/network/neutron.py:2360}} Apr 05 12:16:35.086813 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:35.087952 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:35.096560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:35.097071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:35.097913 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:35.098436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:35.205721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b1607d5d-c2b7-476a-9e1e-df4dde05d395 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.123848 Apr 05 12:16:35.209985 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 564/1182] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:35 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:35.290270 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 05 12:16:35.290751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image limits 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 05 12:16:35.291295 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Flavor pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 05 12:16:35.291757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Image pref 0:0:0 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 05 12:16:35.292217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.virt.hardware [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98312) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 05 12:16:35.301192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:35.301698 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:35.302602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:35.303099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:35.324354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 05 12:16:35.329156 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.quota [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Getting quotas for user 75522f4b270e42e4b1ce7a6a09beb7ec and project 629fa1a565724595a30468e1271ead78. Resources: {'cores', 'ram', 'instances'} {{(pid=98312) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 05 12:16:35.448413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Going to run 1 instances... {{(pid=98312) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 05 12:16:35.451021 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e553894f-5b54-4df0-b5a3-c916a7713378',volume_size=None,volume_type=None)] {{(pid=98312) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 05 12:16:35.662116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a30eb4ea-6714-41ea-a4d1-4a1b887714d3 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.176478 Apr 05 12:16:35.663430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 619/1183] 10.222.0.36 () {60 vars in 1137 bytes} [Mon Apr 5 12:16:34 2021] POST /compute/v2.1/servers => generated 405 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 05 12:16:35.675770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5ddff66d-40a1-45d0-8b4d-574022a49c47 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:35.676842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5ddff66d-40a1-45d0-8b4d-574022a49c47 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:35.762820 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5ddff66d-40a1-45d0-8b4d-574022a49c47 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:35.775629 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5ddff66d-40a1-45d0-8b4d-574022a49c47 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1091 microversion: 2.1 time: 0.104599 Apr 05 12:16:35.776302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 565/1184] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:35 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1091 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:36.218222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:36.219371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:36.228388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:36.228897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:36.229739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:36.230257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:36.331180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c5b1180a-26f2-447e-ab23-cdd5297d1937 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.116963 Apr 05 12:16:36.331901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 620/1185] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:36 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:36.795031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:36.795769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:36.806278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:36.806278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:36.807025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:36.807519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:36.935606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:36.953135 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dcd18326-41f1-4edf-b791-55edd6fc1f54 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1207 microversion: 2.1 time: 0.162077 Apr 05 12:16:36.954349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 566/1186] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:36 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1207 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:37.345293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:37.346470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:37.356068 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:37.356580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:37.357475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:37.357969 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:37.457231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bc4a306d-14fc-4528-ba70-274af86a5b08 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 28672 microversion: 2.1 time: 0.116245 Apr 05 12:16:37.458886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 621/1187] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:37 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 28672 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:37.971979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:37.972658 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:37.981349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:37.981869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:37.982752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:37.983253 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:38.219373 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:38.229109 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a0c73593-81d2-4148-85e1-5addbb68de3c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.261351 Apr 05 12:16:38.229743 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 567/1188] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:37 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:38.471023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:38.472330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:38.481572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:38.482207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:38.483051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:38.483546 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:38.581099 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6aa938df-f16a-495b-a0f2-c145886f57f0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 29222 microversion: 2.1 time: 0.114539 Apr 05 12:16:38.586075 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 622/1189] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:38 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 29222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:39.232839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-2ec2ff7d-9f48-451f-b86d-6f3c4ad84c18 req-b6f1c57e-f0a2-4821-9568-fecf68d06fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff66a83-2b9f-4f11-8eb6-31d4166134ca", "tag": "8df2e0cf-aba6-4f50-8e67-e3b51b39cb13"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:39.234610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:16:39.234610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:16:39.245074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-2ec2ff7d-9f48-451f-b86d-6f3c4ad84c18 req-b6f1c57e-f0a2-4821-9568-fecf68d06fae service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:39.248668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:39.249457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:39.250437 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-2ec2ff7d-9f48-451f-b86d-6f3c4ad84c18 req-b6f1c57e-f0a2-4821-9568-fecf68d06fae service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:39.260506 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:39.261273 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:39.262309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:39.262954 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:39.459769 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-2ec2ff7d-9f48-451f-b86d-6f3c4ad84c18 req-b6f1c57e-f0a2-4821-9568-fecf68d06fae service nova] Creating event network-changed:8df2e0cf-aba6-4f50-8e67-e3b51b39cb13 for instance bff66a83-2b9f-4f11-8eb6-31d4166134ca on hv-cinder-78476 Apr 05 12:16:39.464869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-2ec2ff7d-9f48-451f-b86d-6f3c4ad84c18 req-b6f1c57e-f0a2-4821-9568-fecf68d06fae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236062 Apr 05 12:16:39.465523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 568/1190] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:16:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:39.593918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:39.595070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:39.603816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:39.604320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:39.605151 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:39.605640 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:39.704070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-64f50cfd-0b45-416e-8e56-f0b8035953b2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 31314 microversion: 2.1 time: 0.114338 Apr 05 12:16:39.704681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 569/1191] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:39 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 31314 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:39.741408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:39.750333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8b7de07e-7de0-4952-b14e-f5821490c502 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.506274 Apr 05 12:16:39.750968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 623/1192] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:39 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:40.717287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:40.718458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:40.727063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:40.727576 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:40.728416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:40.728906 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:40.768889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:40.769560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:40.778186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:40.778693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:40.779706 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:40.780195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:40.844070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-92d17188-99c0-49bb-aadf-2c6ea04a92ad tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 33063 microversion: 2.1 time: 0.131052 Apr 05 12:16:40.845430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 570/1193] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:40 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 33063 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:41.169974 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:41.179140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3f0e8bad-3592-46cb-bbae-62281b1376da tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.414270 Apr 05 12:16:41.179774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 624/1194] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:40 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:41.857627 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:41.858777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:41.867799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:41.868296 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:41.869123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:41.869608 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:41.968292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-70ac725f-f304-47fc-9350-26df85b1455c tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 33779 microversion: 2.1 time: 0.115013 Apr 05 12:16:41.968960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 571/1195] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:41 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 33779 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:42.197870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:42.198610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:42.206474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:42.206991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:42.207828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:42.208328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:42.414526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:42.423498 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f60f43d-1c0e-4259-a5af-4eaf19ff7bc1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.230318 Apr 05 12:16:42.424127 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 625/1196] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:42 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:42.980984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:42.982100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:42.990543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:42.991554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:42.992376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:42.992861 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:43.095945 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3da570f-806f-4d3b-8c4b-5452cbdcb640 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 35107 microversion: 2.1 time: 0.119308 Apr 05 12:16:43.096625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 572/1197] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:42 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 35107 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:43.441770 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:43.442390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:43.450568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:43.451071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:43.451896 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:43.452377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:43.665505 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:43.674181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6e2411fe-7334-467e-9ae8-c4ef03d9a4d4 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.236478 Apr 05 12:16:43.674801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 626/1198] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:43 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:44.109713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:44.111586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:44.120982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:44.121518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:44.122464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:44.122957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:44.222754 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a50885cd-a28c-471d-ba25-ba4e09e0e499 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 36554 microversion: 2.1 time: 0.117315 Apr 05 12:16:44.223458 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 573/1199] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:44 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 36554 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:44.691955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:44.692636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:44.700539 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:44.701051 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:44.701886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:44.702405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:44.908408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:44.917957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-81400271-bec5-4f3e-9503-60b1e071f064 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.230099 Apr 05 12:16:44.918641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 627/1200] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:44 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:45.236228 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:45.237361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:45.246287 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:45.246793 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:45.247618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:45.248108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:45.348601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3da0ef9b-9f2e-4d64-b3be-6aeb73e4a673 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 38072 microversion: 2.1 time: 0.116751 Apr 05 12:16:45.349275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 574/1201] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:45 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 38072 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:45.936158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:45.936874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:45.945605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:45.946117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:45.947004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:45.947491 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:46.158374 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:46.167953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-69e70e7c-5f75-4d57-b767-1e6d9df824be tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.235878 Apr 05 12:16:46.168578 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 628/1202] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:45 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:46.362161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:46.363301 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:46.372575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:46.373090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:46.373928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:46.374449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:46.476588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7c6ed7c7-0a97-41a5-bf6a-1b783e2ba379 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 38206 microversion: 2.1 time: 0.118815 Apr 05 12:16:46.477261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 575/1203] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:46 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 38206 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:47.185716 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:47.186435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:47.194683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:47.195189 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:47.196020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:47.196507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:47.409275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:47.418961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b265be85-7d83-4ee6-bf30-de3c7a7955b8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.237262 Apr 05 12:16:47.419577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 629/1204] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:47 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:47.489748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:47.490905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:47.499402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:47.499909 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:47.500737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:47.501226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:47.606411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c9231e7c-87b7-409f-ba25-72845900880d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 38206 microversion: 2.1 time: 0.120976 Apr 05 12:16:47.607097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 576/1205] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:47 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 38206 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 05 12:16:48.438382 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:48.439060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:48.447571 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:48.448080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:48.448912 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:48.449399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:48.619646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:48.620780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:48.629362 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:48.629892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:48.630750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:48.631242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:48.659126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:48.669172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d2fcb882-dba4-4007-b789-018c36d9afd8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.235044 Apr 05 12:16:48.669967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 630/1206] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:48 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:48.800499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2d007c52-f800-4219-bf1c-2bff31526b76 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 38206 microversion: 2.1 time: 0.185097 Apr 05 12:16:48.801302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 577/1207] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:48 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 38206 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:49.687678 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:49.688349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:49.696271 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.696822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:49.697828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.698364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:49.814164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:49.815311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:49.824180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.824693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:49.825541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.826035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:49.913343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:49.923073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-87c3000d-f2fe-47d6-9c23-d47be95f6964 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.239455 Apr 05 12:16:49.923694 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 631/1208] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:49 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:49.938855 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-72645b94-b313-4cbb-b4b2-50b973488156 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action" status: 200 len: 38337 microversion: 2.1 time: 0.128882 Apr 05 12:16:49.939514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 578/1209] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:16:49 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/action => generated 38337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 05 12:16:49.949734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:49.950305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:49.958172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.958707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:49.959541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:49.960031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:50.022370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4976524-f3c4-4703-88f2-86e0dbdc1fe4 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/ips" status: 200 len: 146 microversion: 2.1 time: 0.076489 Apr 05 12:16:50.022993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 632/1210] 10.222.0.36 () {58 vars in 1238 bytes} [Mon Apr 5 12:16:49 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:50.430725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-e26fe43e-c1ef-4339-bdc8-2fb174769318 req-eabe419b-548a-42cc-ae76-de918c983ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff66a83-2b9f-4f11-8eb6-31d4166134ca", "name": "network-vif-plugged", "status": "completed", "tag": "8df2e0cf-aba6-4f50-8e67-e3b51b39cb13"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:50.432415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:16:50.432415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:16:50.442090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e26fe43e-c1ef-4339-bdc8-2fb174769318 req-eabe419b-548a-42cc-ae76-de918c983ccc service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:50.442642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-e26fe43e-c1ef-4339-bdc8-2fb174769318 req-eabe419b-548a-42cc-ae76-de918c983ccc service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:50.460319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-e26fe43e-c1ef-4339-bdc8-2fb174769318 req-eabe419b-548a-42cc-ae76-de918c983ccc service nova] Creating event network-vif-plugged:8df2e0cf-aba6-4f50-8e67-e3b51b39cb13 for instance bff66a83-2b9f-4f11-8eb6-31d4166134ca on hv-cinder-78476 Apr 05 12:16:50.465789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-e26fe43e-c1ef-4339-bdc8-2fb174769318 req-eabe419b-548a-42cc-ae76-de918c983ccc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039888 Apr 05 12:16:50.466545 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 579/1211] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:50.941925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:50.942623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:50.951130 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:50.951641 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:50.952471 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:50.952960 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:51.160319 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:51.170009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-aa61811f-1b09-4278-8034-380636ba932e tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1262 microversion: 2.1 time: 0.232178 Apr 05 12:16:51.170656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 633/1212] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:50 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1262 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:51.540714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4192ca47-515a-4552-87e1-c51f74c6b164"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:51.542010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:51.550105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:51.550681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:51.551524 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:51.552018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:51.918266 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-411c5ee0-0f82-413c-bb7e-0c1d64efe51d tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382825 Apr 05 12:16:51.918944 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 580/1213] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:16:51 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:52.190013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:52.191574 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:52.201603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:52.202110 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:52.203049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:52.203523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:52.416497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:52.425411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-49271f25-9656-496b-8916-294d2b7fa599 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1448 microversion: 2.1 time: 0.241508 Apr 05 12:16:52.426033 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 634/1214] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:52 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1448 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:52.444027 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:52.444800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:52.454311 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:52.454822 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:52.455659 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:52.456153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:52.667940 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:16:52.676789 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0ea93ed5-b512-4ef3-ab39-c7824a4c5c55 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1448 microversion: 2.1 time: 0.237378 Apr 05 12:16:52.677465 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 581/1215] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:16:52 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1448 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:16:55.687604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-844640ed-9481-4a79-9522-d2cb73cbcc2e req-5348c1ce-efa7-4eba-8505-91e99dae857f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff66a83-2b9f-4f11-8eb6-31d4166134ca", "tag": "8df2e0cf-aba6-4f50-8e67-e3b51b39cb13"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:16:55.689617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:16:55.689617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:16:55.699059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-844640ed-9481-4a79-9522-d2cb73cbcc2e req-5348c1ce-efa7-4eba-8505-91e99dae857f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:55.699662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-844640ed-9481-4a79-9522-d2cb73cbcc2e req-5348c1ce-efa7-4eba-8505-91e99dae857f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:55.716749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-844640ed-9481-4a79-9522-d2cb73cbcc2e req-5348c1ce-efa7-4eba-8505-91e99dae857f service nova] Creating event network-changed:8df2e0cf-aba6-4f50-8e67-e3b51b39cb13 for instance bff66a83-2b9f-4f11-8eb6-31d4166134ca on hv-cinder-78476 Apr 05 12:16:55.722304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-844640ed-9481-4a79-9522-d2cb73cbcc2e req-5348c1ce-efa7-4eba-8505-91e99dae857f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038832 Apr 05 12:16:55.722948 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 635/1216] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:16:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:59.758445 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:59.760132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:59.768397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:59.768911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:59.769750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:59.770278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:59.839650 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1bc190fe-2f0e-4527-900a-2910044d5e4a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085254 Apr 05 12:16:59.840275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 582/1217] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:16:59 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:16:59.852504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:16:59.853157 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:16:59.861722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:59.862257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:59.863222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:16:59.863720 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:16:59.934215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fa62738a-569b-458a-be95-48dacff9b4fd tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164" status: 200 len: 194 microversion: 2.1 time: 0.086299 Apr 05 12:16:59.934863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 636/1218] 10.222.0.36 () {58 vars in 1403 bytes} [Mon Apr 5 12:16:59 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:01.435013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff67bd0-b2ae-4b86-bde9-351316690cd8"}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:17:01.436193 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:01.443936 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:01.444443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:01.445285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:01.445774 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:01.805779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9dbfdb0c-37ba-41f1-ae87-cb761931ebc6 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375153 Apr 05 12:17:01.806761 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 583/1219] 10.222.0.36 () {60 vars in 1313 bytes} [Mon Apr 5 12:17:01 2021] POST /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:09.638141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:09.639201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:09.646911 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:09.647410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:09.648233 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:09.648718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:09.715975 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c397fa9d-d3b6-4bb6-a113-19b1d5024c46 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.082449 Apr 05 12:17:09.716566 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 637/1220] 10.222.0.36 () {58 vars in 1292 bytes} [Mon Apr 5 12:17:09 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:09.906209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:09.906807 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:09.916187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:09.916709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:09.917547 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:09.918083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:09.987020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-98d2577c-c60b-4c30-819b-44accc940fc2 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164" status: 200 len: 194 microversion: 2.1 time: 0.086546 Apr 05 12:17:09.987656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 584/1221] 10.222.0.36 () {58 vars in 1403 bytes} [Mon Apr 5 12:17:09 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:09.998618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:09.999259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:10.007045 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:10.007557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:10.008378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:10.008863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:10.183529 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lazy-loading 'services' on Instance uuid 9b09822d-7a64-412e-b682-76883101e238 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:17:10.322567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6bb119c5-ee7c-4e39-9e02-60aa3ab23b31 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164" status: 202 len: 0 microversion: 2.1 time: 0.328516 Apr 05 12:17:10.323210 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 638/1222] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:17:09 2021] DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4192ca47-515a-4552-87e1-c51f74c6b164 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:17:12.629918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:12.630523 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:12.639504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:12.640005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:12.640827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:12.641316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:12.708685 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6e0df81a-6ddf-4693-933f-d6a3ab36fdfe tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4ff67bd0-b2ae-4b86-bde9-351316690cd8" status: 200 len: 194 microversion: 2.1 time: 0.082795 Apr 05 12:17:12.709328 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 585/1223] 10.222.0.36 () {58 vars in 1403 bytes} [Mon Apr 5 12:17:12 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4ff67bd0-b2ae-4b86-bde9-351316690cd8 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:12.720776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:12.721432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:12.730063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:12.730612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:12.731453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:12.731946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:12.915464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lazy-loading 'services' on Instance uuid 9b09822d-7a64-412e-b682-76883101e238 {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:17:13.055396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2aa6e499-2a23-41a6-a419-1b24c7ae6e7a tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4ff67bd0-b2ae-4b86-bde9-351316690cd8" status: 202 len: 0 microversion: 2.1 time: 0.339077 Apr 05 12:17:13.056030 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 639/1224] 10.222.0.36 () {58 vars in 1406 bytes} [Mon Apr 5 12:17:12 2021] DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238/os-volume_attachments/4ff67bd0-b2ae-4b86-bde9-351316690cd8 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:17:14.643249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:14.643812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:14.652504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:14.653087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:14.653903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:14.654432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:14.717946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:17:14.830835 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c71f9b7e-303a-4fa0-a02c-489f3343dd78 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 204 len: 0 microversion: 2.1 time: 0.191235 Apr 05 12:17:14.831417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 586/1225] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:17:14 2021] DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:17:14.840804 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:14.841618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:14.849612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:14.850144 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:14.851022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:14.851507 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:15.065751 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:15.075227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c3b8b8ae-4bed-4f4d-b477-bf75c17338e0 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1674 microversion: 2.1 time: 0.239051 Apr 05 12:17:15.075848 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 640/1226] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:14 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:16.094405 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:16.095175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:16.103657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:16.104304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:16.105158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:16.105654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:16.320140 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:16.328997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1942333f-e7f4-4799-a017-4ef816850f70 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1674 microversion: 2.1 time: 0.239135 Apr 05 12:17:16.329597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 587/1227] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:16 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:17.348272 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:17.348977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:17.357417 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:17.357929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:17.358799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:17.359293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:17.766171 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:17.775531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ab9c4650-35c2-4114-81b7-3bfb8f2580a3 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1674 microversion: 2.1 time: 0.430810 Apr 05 12:17:17.776459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 641/1228] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:17 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1674 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:18.793806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:18.794532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:18.802914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:18.803433 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:18.804278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:18.804773 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:18.933794 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd05b2cae18804218aa53adcf160327d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525c6898bd0b4bc98230f38ee54db7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:18.942797 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-75dc571f-fb4e-46a9-ae8f-db7c6cc892cc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 200 len: 1606 microversion: 2.1 time: 0.153650 Apr 05 12:17:18.943430 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 588/1229] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:18 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:19.147478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-6e58296c-33d4-49fb-9dc7-10477d1112d4 req-1baab338-7e61-4c8c-8bb1-db8ed844195e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b09822d-7a64-412e-b682-76883101e238", "name": "network-vif-deleted", "tag": "01581f08-eae8-48fc-8341-e867d2a86c52"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:17:19.149800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:17:19.149800 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:17:19.164768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-6e58296c-33d4-49fb-9dc7-10477d1112d4 req-1baab338-7e61-4c8c-8bb1-db8ed844195e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:19.165719 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-6e58296c-33d4-49fb-9dc7-10477d1112d4 req-1baab338-7e61-4c8c-8bb1-db8ed844195e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:19.184582 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-6e58296c-33d4-49fb-9dc7-10477d1112d4 req-1baab338-7e61-4c8c-8bb1-db8ed844195e service nova] Creating event network-vif-deleted:01581f08-eae8-48fc-8341-e867d2a86c52 for instance 9b09822d-7a64-412e-b682-76883101e238 on hv-cinder-78476 Apr 05 12:17:19.189979 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-6e58296c-33d4-49fb-9dc7-10477d1112d4 req-1baab338-7e61-4c8c-8bb1-db8ed844195e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046447 Apr 05 12:17:19.190675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 642/1230] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:19.962082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:19.963812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:19.971630 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:19.972143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:19.972983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:19.973509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:20.026011 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. Apr 05 12:17:20.026708 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:20.027867 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e52bd0d1-dc51-47d0-b862-5a90a072a2eb tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 404 len: 111 microversion: 2.1 time: 0.069975 Apr 05 12:17:20.028484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 589/1231] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:19 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:20.038450 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b4340f37-b5de-445b-89bf-c20ce93d0b42 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '.version_select at 0x7f0100f99268>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:20.055129 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b4340f37-b5de-445b-89bf-c20ce93d0b42 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-857483574" status: 202 len: 0 microversion: 2.1 time: 0.021438 Apr 05 12:17:20.055763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 643/1232] 10.222.0.36 () {58 vars in 1208 bytes} [Mon Apr 5 12:17:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-857483574 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:17:21.211534 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:21.212091 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:21.219916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:21.220427 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:21.221259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:21.221752 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:21.287965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Going to try to terminate instance {{(pid=98311) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:17:21.404125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9374bfc7-0e1a-443e-a2b3-f1b0050c0c12 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 204 len: 0 microversion: 2.20 time: 0.196241 Apr 05 12:17:21.404786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 590/1233] 10.222.0.36 () {60 vars in 1270 bytes} [Mon Apr 5 12:17:21 2021] DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:17:21.413544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:21.414391 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:21.423285 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:21.423806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:21.424652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:21.425147 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:21.888984 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:21.898553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:21.900283 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:21.901518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-acfb184c-f876-4267-8ac1-06fa69479285 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.492175 Apr 05 12:17:21.902420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 644/1234] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:17:21 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:17:22.923201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:22.923968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:22.932601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:22.933042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:22.933895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:22.934416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:23.155957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:23.165616 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:23.167320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:23.168535 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ee34f99d-96dd-4ea0-953c-b4d07ee2b6b2 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1725 microversion: 2.20 time: 0.250053 Apr 05 12:17:23.169164 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 591/1235] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:17:22 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:17:24.188078 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:24.188749 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:24.197092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.197714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.198760 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.199357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.682396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:24.694586 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:24.700393 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614d6c5d4c9f483796cbd1bccbb4b3f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a08590013048999464095fb2986698', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:24.701888 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c038b92f-d1a0-4246-9129-b4cf95c5005c tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 200 len: 1657 microversion: 2.20 time: 0.517994 Apr 05 12:17:24.702764 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 645/1236] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:17:24 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 1657 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 05 12:17:24.754732 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:24.755543 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:24.764502 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.765001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.765856 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.766388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.819651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. Apr 05 12:17:24.820330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:24.821245 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-07b391bc-7ff6-4ddd-b027-f15f59ef3ece tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 404 len: 111 microversion: 2.1 time: 0.070620 Apr 05 12:17:24.823050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 592/1237] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:17:24 2021] DELETE /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:24.831457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:24.832364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: 9b09822d-7a64-412e-b682-76883101e238] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:24.840519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.841115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.842073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:24.842713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:24.898833 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. Apr 05 12:17:24.899438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance 9b09822d-7a64-412e-b682-76883101e238 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:24.900620 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1604f63f-70b1-491e-95bb-a8d81053e368 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238" status: 404 len: 111 microversion: 2.1 time: 0.072913 Apr 05 12:17:24.900990 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 646/1238] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:24 2021] GET /compute/v2.1/servers/9b09822d-7a64-412e-b682-76883101e238 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:25.044639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-c8e6f265-e5e3-4f67-a23f-65c77710e82a req-4448c15f-83f7-40e3-8e4c-da9e63cf07ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7526c1-27ee-4858-bfb2-afe77dedf39b", "name": "network-vif-deleted", "tag": "e00de149-216d-469b-8615-093620f8f903"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:17:25.046977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:17:25.046977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:17:25.057665 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c8e6f265-e5e3-4f67-a23f-65c77710e82a req-4448c15f-83f7-40e3-8e4c-da9e63cf07ed service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:25.058306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c8e6f265-e5e3-4f67-a23f-65c77710e82a req-4448c15f-83f7-40e3-8e4c-da9e63cf07ed service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:25.083623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-c8e6f265-e5e3-4f67-a23f-65c77710e82a req-4448c15f-83f7-40e3-8e4c-da9e63cf07ed service nova] Creating event network-vif-deleted:e00de149-216d-469b-8615-093620f8f903 for instance bf7526c1-27ee-4858-bfb2-afe77dedf39b on hv-cinder-78476 Apr 05 12:17:25.090015 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-c8e6f265-e5e3-4f67-a23f-65c77710e82a req-4448c15f-83f7-40e3-8e4c-da9e63cf07ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050529 Apr 05 12:17:25.091116 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 593/1239] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:17:25.721399 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:25.722215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:25.730291 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:25.730799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:25.731633 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:25.732125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:25.784995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. Apr 05 12:17:25.785667 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:25.786595 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f80843e-8fa4-4994-af70-798966fb3cfa tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 404 len: 111 microversion: 2.20 time: 0.069421 Apr 05 12:17:25.787218 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 647/1240] 10.222.0.36 () {60 vars in 1267 bytes} [Mon Apr 5 12:17:25 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 05 12:17:25.797121 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4c0b1cc1-faac-4cad-bbc7-c4e7b679d259 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '.version_select at 0x7f01024946a8>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:25.815170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4c0b1cc1-faac-4cad-bbc7-c4e7b679d259 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412218617" status: 204 len: 0 microversion: 2.20 time: 0.022673 Apr 05 12:17:25.816043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 594/1241] 10.222.0.36 () {60 vars in 1252 bytes} [Mon Apr 5 12:17:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412218617 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 05 12:17:26.189821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:26.190594 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:26.199409 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:26.200042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:26.201000 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:26.202187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:26.256053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. Apr 05 12:17:26.256731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:26.257638 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-9fdafcb3-2e51-45f4-8b00-6c5b799fd3bc tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 404 len: 111 microversion: 2.1 time: 0.072210 Apr 05 12:17:26.258299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 648/1242] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:17:26 2021] DELETE /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:26.267563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:26.268762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] [instance: a65c1062-5d66-496a-ae26-06d7d61b2fed] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:26.278781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:26.279860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:26.280935 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:26.281487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:26.335915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] HTTP exception thrown: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. Apr 05 12:17:26.336596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] Returning 404 to user: Instance a65c1062-5d66-496a-ae26-06d7d61b2fed could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:26.337601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-03d4def0-c2c6-4f13-8ccc-8f9bb3874950 tempest-AttachVolumeTestJSON-1545638362 tempest-AttachVolumeTestJSON-1545638362-project] 10.222.0.36 "GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed" status: 404 len: 111 microversion: 2.1 time: 0.074155 Apr 05 12:17:26.338244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 595/1243] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:26 2021] GET /compute/v2.1/servers/a65c1062-5d66-496a-ae26-06d7d61b2fed => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 05 12:17:28.320517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:28.321162 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:28.330330 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:28.331114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:28.332043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:28.332606 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:28.398550 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. Apr 05 12:17:28.399217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:28.400661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-60129e0d-f581-402b-9f40-8e533f49dbc4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 404 len: 111 microversion: 2.1 time: 0.084208 Apr 05 12:17:28.401580 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 649/1244] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:17:28 2021] DELETE /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:28.410182 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:28.410870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: bf7526c1-27ee-4858-bfb2-afe77dedf39b] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:28.423713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:28.425553 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:28.426636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:28.427229 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:28.481512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. Apr 05 12:17:28.482198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance bf7526c1-27ee-4858-bfb2-afe77dedf39b could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:28.483112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7790961b-fb02-4b5c-99a7-aeec76663a81 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b" status: 404 len: 111 microversion: 2.1 time: 0.077146 Apr 05 12:17:28.483955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 596/1245] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:28 2021] GET /compute/v2.1/servers/bf7526c1-27ee-4858-bfb2-afe77dedf39b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:29.737756 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:29.738933 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:29.747371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:29.748442 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:29.749512 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:29.750832 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:29.811788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. Apr 05 12:17:29.812572 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:29.813772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f9562c4-8eff-45f6-b8e0-183379f590a4 tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 404 len: 111 microversion: 2.1 time: 0.080086 Apr 05 12:17:29.814661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 650/1246] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:17:29 2021] DELETE /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:29.823863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:29.824542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] [instance: 41cc66fe-6283-4798-b54a-9647f39a77ad] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:29.832656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:29.833207 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:29.834039 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:29.834558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:29.888900 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] HTTP exception thrown: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. Apr 05 12:17:29.889584 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] Returning 404 to user: Instance 41cc66fe-6283-4798-b54a-9647f39a77ad could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:17:29.890516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-da54658f-5d4f-4bb8-8013-8a59e8defe7b tempest-AttachVolumeShelveTestJSON-386860089 tempest-AttachVolumeShelveTestJSON-386860089-project] 10.222.0.36 "GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad" status: 404 len: 111 microversion: 2.1 time: 0.071660 Apr 05 12:17:29.891132 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 597/1247] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:29 2021] GET /compute/v2.1/servers/41cc66fe-6283-4798-b54a-9647f39a77ad => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:17:36.407158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-15f44ac5-05b3-46b8-9e26-0a00cef11c4d tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0100ce9b70>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:36.512569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-15f44ac5-05b3-46b8-9e26-0a00cef11c4d tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/8969a6b3-9075-4b85-84e4-6d4bbf9c67ec" status: 200 len: 351 microversion: 2.1 time: 0.109452 Apr 05 12:17:36.513355 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 651/1248] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:17:36 2021] GET /compute/v2.1/os-volumes/8969a6b3-9075-4b85-84e4-6d4bbf9c67ec => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:38.048426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a1005122-9e1b-4cdd-928c-0b9dd02d8844 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0105afe2f0>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:38.155053 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a1005122-9e1b-4cdd-928c-0b9dd02d8844 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9cb64d42-b148-46ee-b6e8-fbed832ce0ec" status: 200 len: 351 microversion: 2.1 time: 0.111237 Apr 05 12:17:38.155668 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 598/1249] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:17:38 2021] GET /compute/v2.1/os-volumes/9cb64d42-b148-46ee-b6e8-fbed832ce0ec => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:39.816653 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-49bb71bc-5a60-40bd-b610-fca0f7b28680 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f01019e8378>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:39.913970 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-49bb71bc-5a60-40bd-b610-fca0f7b28680 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d7c0d8c7-fafa-4299-9b11-10944d7d7920" status: 200 len: 350 microversion: 2.1 time: 0.101193 Apr 05 12:17:39.914628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 652/1250] 10.222.0.36 () {58 vars in 1235 bytes} [Mon Apr 5 12:17:39 2021] GET /compute/v2.1/os-volumes/d7c0d8c7-fafa-4299-9b11-10944d7d7920 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:39.927054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-918ae7fb-f6dd-42a8-aa77-649a20e368c8 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0105afe620>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.019628 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-918ae7fb-f6dd-42a8-aa77-649a20e368c8 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096512 Apr 05 12:17:40.020261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 599/1251] 10.222.0.36 () {58 vars in 1124 bytes} [Mon Apr 5 12:17:39 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:40.033256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f6ead9eb-53a7-4fe7-abd0-5d290d1f4264 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0100f99620>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.123216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f6ead9eb-53a7-4fe7-abd0-5d290d1f4264 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093828 Apr 05 12:17:40.123842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 653/1252] 10.222.0.36 () {58 vars in 1139 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:40.137185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d9b09e02-f86f-459a-9359-5cb92844593b tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f010a71bd08>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.224042 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d9b09e02-f86f-459a-9359-5cb92844593b tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090866 Apr 05 12:17:40.224675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 600/1253] 10.222.0.36 () {58 vars in 1124 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:40.237117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3c1f4b95-b4b9-408c-9175-cbf5d434c1bf tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0101a49d90>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.326504 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3c1f4b95-b4b9-408c-9175-cbf5d434c1bf tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093157 Apr 05 12:17:40.327195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 654/1254] 10.222.0.36 () {58 vars in 1157 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:40.341565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-973023f0-8172-436b-9a48-4450ccdb6cf9 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0101a93e18>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.431799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-973023f0-8172-436b-9a48-4450ccdb6cf9 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094579 Apr 05 12:17:40.432429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 601/1255] 10.222.0.36 () {58 vars in 1160 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:40.444918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8a035421-d146-4624-a708-64948b945c81 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0100ce99d8>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.531597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8a035421-d146-4624-a708-64948b945c81 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090462 Apr 05 12:17:40.532276 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 655/1256] 10.222.0.36 () {58 vars in 1145 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:40.544748 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d78fc33e-c854-4bf2-a2d5-4eccb4664777 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0105afe268>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.630967 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d78fc33e-c854-4bf2-a2d5-4eccb4664777 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090734 Apr 05 12:17:40.631642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 602/1257] 10.222.0.36 () {58 vars in 1178 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:17:40.644982 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b8144c5f-f769-426f-9f45-1ac95df2a8d4 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] Calling method '.version_select at 0x7f0100fa18c8>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:40.733181 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b8144c5f-f769-426f-9f45-1ac95df2a8d4 tempest-VolumesTestJSON-2120634442 tempest-VolumesTestJSON-2120634442-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092142 Apr 05 12:17:40.733806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 656/1258] 10.222.0.36 () {58 vars in 1145 bytes} [Mon Apr 5 12:17:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:51.908490 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:17:51.909740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:51.924412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:51.925049 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:51.925894 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:51.926412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:51.997043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lazy-loading 'flavor' on Instance uuid 79c60877-1e5d-4312-a660-a4763656292f {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:17:52.157371 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-0a3ac83c-f960-486b-b75d-26853d0e083e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "POST /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f/action" status: 202 len: 0 microversion: 2.1 time: 0.253960 Apr 05 12:17:52.158363 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 603/1259] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:17:51 2021] POST /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:17:52.167672 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:52.168348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:52.176784 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:52.177298 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:52.178199 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:52.178661 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:52.394320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:52.404381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7f1cd84e-e951-4d15-95b2-956fb64e1a2e tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.241507 Apr 05 12:17:52.404995 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 657/1260] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:52 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:53.428968 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:53.429763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:53.439255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:53.439714 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:53.440570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:53.441074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:53.678532 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:53.688499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f31f4b3b-f638-4208-b071-ea2142aac6db tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.263909 Apr 05 12:17:53.689196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 604/1261] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:53 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:54.707320 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:54.708010 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:54.717440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:54.717955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:54.718839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:54.719343 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:54.955090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:54.965093 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e873a582-47b3-45f6-b63b-3b357b19672a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.262027 Apr 05 12:17:54.965726 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 658/1262] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:54 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:55.983818 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:55.984499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:55.992865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:55.993378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:55.994303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:55.995282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:56.294585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:56.303377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-97524866-ca35-438a-a2ad-d85f01c54c8f tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.323692 Apr 05 12:17:56.304007 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 605/1263] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:55 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:57.323062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:57.323737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:57.331479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:57.331977 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:57.332850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:57.333334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:57.551497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:57.560991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-77c86564-0acd-4146-8cba-a14aa0f4b7c7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.242760 Apr 05 12:17:57.561607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 659/1264] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:57 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:58.579072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:58.579766 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:58.588258 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:58.588763 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:58.589612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:58.590098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:58.812860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:17:58.822488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8c99823f-f40b-427a-bcbb-300241b661d5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.246847 Apr 05 12:17:58.823125 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 606/1265] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:58 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:17:59.840905 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:17:59.841577 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:17:59.850601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:59.851134 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:17:59.852062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:17:59.852585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:00.077108 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:00.085959 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3f6df424-c63d-4f56-9e51-89547fc593e7 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.249312 Apr 05 12:18:00.086652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 660/1266] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:17:59 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:01.104830 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:01.105660 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:01.114914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:01.115715 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:01.116746 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:01.117432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:01.352223 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:01.361916 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f4c86a89-1f38-4da7-9344-994ebfe9d6c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.261676 Apr 05 12:18:01.362786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 607/1267] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:01 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:02.380117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:02.380806 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:02.389560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:02.390105 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:02.390976 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:02.391474 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:02.612670 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:02.621683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e92192f-398f-4784-9ea3-c748ac89d9c3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.245367 Apr 05 12:18:02.622367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 661/1268] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:02 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:03.640217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:03.640924 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:03.648718 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:03.649321 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:03.650880 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:03.651449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:03.871240 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:03.880153 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c51e3e8c-6ec9-4815-8299-d904909882be tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.244142 Apr 05 12:18:03.880799 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 608/1269] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:03 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:04.898785 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:04.899511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:04.909004 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:04.909555 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:04.910517 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:04.911096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:05.142333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:05.152874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1cf8faf0-e4d8-4097-86fe-b5a3a601c242 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.257718 Apr 05 12:18:05.153519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 662/1270] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:04 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:18:06.171738 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:06.172413 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:06.180195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:06.181563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:06.182882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:06.183376 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:06.398934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:06.407991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-06fc4e7e-d508-4dd8-8cf7-df229d4d233b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.240261 Apr 05 12:18:06.408647 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 609/1271] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:06 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:07.427071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:07.427747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:07.436175 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:07.436674 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:07.437497 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:07.437987 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:07.653069 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:07.661892 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-985b67f7-7ba6-4c8c-bd52-756f7affdaed tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.238816 Apr 05 12:18:07.662542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 663/1272] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:07 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:08.680631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:08.681310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:08.689009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:08.689514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:08.690375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:08.690863 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:08.905077 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:08.913879 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fc9273e6-53fd-4493-9168-75c44d9425ec tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.237358 Apr 05 12:18:08.914542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 610/1273] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:08 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:09.932354 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:09.932961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:09.940829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:09.941378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:09.942259 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:09.942757 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:10.164059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:10.176396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a0235815-f5da-4a9c-b85c-e02a9aaffc01 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.248403 Apr 05 12:18:10.177028 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 664/1274] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:09 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:11.194938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:11.195605 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:11.203812 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:11.204337 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:11.205160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:11.205657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:11.427377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:11.436133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cd21abcc-8f32-48d6-bafb-782f8894c388 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.245171 Apr 05 12:18:11.436750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 611/1275] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:11 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:12.455242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:12.455841 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:12.464823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:12.465322 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:12.466186 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:12.466684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:12.680994 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:12.689917 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1c3f6089-4883-48eb-b597-fe65fdba43bb tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.238749 Apr 05 12:18:12.690592 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 665/1276] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:12 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:13.708370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:13.709043 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:13.717009 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:13.717520 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:13.718390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:13.718882 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:13.925731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:13.935467 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c15258cb-6682-42d9-881e-6c755c3372d3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.231124 Apr 05 12:18:13.936090 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 612/1277] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:13 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:14.953482 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:14.954214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:14.962581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:14.963092 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:14.963938 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:14.964429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:15.312096 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:15.320998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-134afd66-5215-4ba7-bb92-97a48e5164cc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.371576 Apr 05 12:18:15.322209 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 666/1278] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:14 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:16.346662 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:16.347357 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:16.355922 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:16.356440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:16.357335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:16.357839 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:16.576603 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:16.585472 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-286801a1-dbdb-4726-942d-f29b15435ee5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.242950 Apr 05 12:18:16.586100 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 613/1279] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:16 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:17.604072 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:17.604775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:17.612564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:17.613065 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:17.613886 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:17.614401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:17.824615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:17.833429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6011e358-8fcd-4a9f-a686-6106b4f56926 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.233390 Apr 05 12:18:17.834054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 667/1280] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:17 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:18.851844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:18.853390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:18.861293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:18.861781 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:18.862644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:18.863139 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:19.075991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:19.084860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-82e14469-b82b-4a8a-b636-603e6cc6e363 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.237114 Apr 05 12:18:19.085516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 614/1281] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:18 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:20.104401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:20.105073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:20.113730 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:20.114279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:20.115128 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:20.115622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:20.331360 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:20.340710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7a7e420b-649b-4e5d-b871-f1845d9041ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.241092 Apr 05 12:18:20.341336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 668/1282] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:20 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:21.358528 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:21.359201 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:21.367364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:21.368487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:21.369432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:21.369925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:21.577480 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:21.586304 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-448d063f-241a-433d-aba3-30f2dc3d16fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.231799 Apr 05 12:18:21.587457 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 615/1283] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:21 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:22.605036 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:22.605703 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:22.613385 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:22.613891 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:22.614741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:22.615226 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:22.826599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:22.835717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-736df6ec-c4c2-4c78-8103-bd856c3fcf62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.234895 Apr 05 12:18:22.836349 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 669/1284] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:22 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:23.855054 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:23.856083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:23.865094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:23.865817 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:23.867119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:23.867621 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:23.954003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-a63ebbb3-3be5-48fb-bd03-f253d887dcf6 req-301599d5-8082-46a3-b84d-54c49a2d806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "name": "network-vif-unplugged", "status": "completed", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:18:23.955821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:18:23.955821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:18:23.969613 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a63ebbb3-3be5-48fb-bd03-f253d887dcf6 req-301599d5-8082-46a3-b84d-54c49a2d806e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:23.970143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a63ebbb3-3be5-48fb-bd03-f253d887dcf6 req-301599d5-8082-46a3-b84d-54c49a2d806e service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:24.002180 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-a63ebbb3-3be5-48fb-bd03-f253d887dcf6 req-301599d5-8082-46a3-b84d-54c49a2d806e service nova] Creating event network-vif-unplugged:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:18:24.009709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-a63ebbb3-3be5-48fb-bd03-f253d887dcf6 req-301599d5-8082-46a3-b84d-54c49a2d806e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.205308 Apr 05 12:18:24.010858 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 616/1285] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:18:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:18:24.117565 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:24.127552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-1047ccf2-8574-4b6c-8132-fa39cc9d1c12 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.277157 Apr 05 12:18:24.128158 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 670/1286] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:23 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:25.147623 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:25.148669 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:25.158106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.158829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.160083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.160195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.377408 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:25.386652 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-af4523b5-58c9-4138-ac39-0cbb9bb01f50 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1508 microversion: 2.1 time: 0.244001 Apr 05 12:18:25.387278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 617/1287] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:25 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:25.404651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:18:25.405268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:25.412929 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.413429 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.414302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.415388 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.565022 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-06d50681-784e-4191-bc0f-8137fe4ccb51 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "POST /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f/action" status: 202 len: 0 microversion: 2.1 time: 0.164398 Apr 05 12:18:25.568937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 671/1288] 10.222.0.36 () {60 vars in 1268 bytes} [Mon Apr 5 12:18:25 2021] POST /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:18:25.574073 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:25.574776 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:25.582772 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.583222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.584059 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:25.584557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:25.796921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:25.806278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-445f43ba-a5d8-4312-a792-7e52def11a30 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1516 microversion: 2.1 time: 0.236125 Apr 05 12:18:25.806914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 618/1289] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:25 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:26.826361 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:26.827133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:26.835601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:26.836118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:26.837377 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:26.837873 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:27.052568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:27.062070 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e41cdd3-a812-4b3e-9c8d-2c79b4937f05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1518 microversion: 2.1 time: 0.240112 Apr 05 12:18:27.062721 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 672/1290] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:26 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:28.081544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:28.082238 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:28.091335 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:28.091842 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:28.092683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:28.093173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:28.319527 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:28.331138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-dbab7070-e043-4126-b82e-b7941185d549 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1518 microversion: 2.1 time: 0.253619 Apr 05 12:18:28.340084 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 619/1291] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:28 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:29.349552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:29.350161 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:29.358604 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:29.359115 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:29.359943 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:29.360435 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:29.574727 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:29.583618 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3edca22e-5906-4082-8bc7-e52e0067a8f3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.238301 Apr 05 12:18:29.584464 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 673/1292] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:29 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:30.602025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:30.602953 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:30.610893 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:30.611396 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:30.612217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:30.612701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:30.832622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:30.841709 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a90ef946-d583-4cd8-9e58-4f4961fc3143 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.243778 Apr 05 12:18:30.842367 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 620/1293] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:30 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:31.859843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:31.860516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:31.868801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:31.869305 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:31.870166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:31.870644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:32.228426 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:32.237263 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7fe425a5-d917-4e25-8ec6-ae1b1eb86270 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.381437 Apr 05 12:18:32.237876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 674/1294] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:31 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:33.256040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:33.256602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:33.265275 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:33.265824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:33.266710 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:33.267205 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:33.480993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:33.489884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5e91d59f-3b4e-4648-bab6-cae5c5751578 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.237989 Apr 05 12:18:33.490541 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 621/1295] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:33 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:34.508453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:34.509131 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:34.517397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:34.517937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:34.518996 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:34.519479 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:34.834615 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:34.844227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-07c8fb59-a5e3-40e7-81c1-804b37fa00dc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.339823 Apr 05 12:18:34.844845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 675/1296] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:34 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:35.861777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:35.862601 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:35.871148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:35.871844 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:35.872997 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:35.873573 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:36.105370 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:36.116742 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6d3b9020-7175-4f13-b55e-bcf69f2d06ac tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.259046 Apr 05 12:18:36.127353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 622/1297] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:35 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:37.135418 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:37.136731 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:37.145581 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:37.146375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:37.147740 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:37.148438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:37.385591 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:37.395249 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-2b3952bc-4c17-400a-904c-bca592e206ad tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.263929 Apr 05 12:18:37.400864 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 676/1298] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:37 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:38.413459 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:38.414163 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:38.421955 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:38.422499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:38.423333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:38.423826 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:38.642542 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:38.652805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-315ff593-df1a-4cc3-9d17-2cd1bba8a3fc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.243038 Apr 05 12:18:38.653438 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 623/1299] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:38 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:39.672278 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:39.673013 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:39.681983 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:39.682515 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:39.683366 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:39.683854 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:39.929159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:39.938675 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ed70cb03-28cf-4ac0-a2eb-0c4cf2485a19 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.270537 Apr 05 12:18:39.939460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 677/1300] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:39 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:40.957187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:40.957989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:40.966082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:40.966626 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:40.967475 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:40.968060 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:41.191895 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:41.201214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-413f05ca-917b-4b1d-b884-493d08cffc7a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.248066 Apr 05 12:18:41.201834 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 624/1301] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:40 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:42.219684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:42.220602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:42.230850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:42.230850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:42.230850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:42.230850 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:42.476699 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:42.485560 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b9d47ca7-10d3-4b78-9e61-c0530680e8bc tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.270131 Apr 05 12:18:42.486198 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 678/1302] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:42 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:43.504107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:43.504778 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:43.512801 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:43.513306 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:43.514154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:43.514631 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:43.726798 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:43.736101 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e5e74389-dbca-4200-acb0-83698f166e90 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.236067 Apr 05 12:18:43.736736 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 625/1303] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:43 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:44.754412 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:44.755224 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:44.763456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:44.763956 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:44.764779 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:44.765261 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:44.980282 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:44.989518 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-30be7064-ebcb-4679-b418-961b298e6898 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.239167 Apr 05 12:18:44.990242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 679/1304] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:44 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:46.010353 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:46.011369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:46.019915 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:46.020434 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:46.021372 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:46.021869 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:46.243821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:46.253057 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f6fcf6a5-055a-4bf5-b0ae-65fd85485d62 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.248622 Apr 05 12:18:46.253691 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 626/1305] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:46 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:47.271401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:47.272117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:47.280705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:47.281235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:47.282050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:47.282570 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:47.495407 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:47.504463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-7b5f49d6-9a30-4111-a1c9-9cfc7fcd065a tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.237186 Apr 05 12:18:47.505097 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 680/1306] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:47 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:48.523400 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:48.524071 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:48.532860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:48.533369 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:48.534243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:48.534739 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:48.744448 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:48.753310 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f43af4c5-6641-4253-8199-9f3053e7b0ff tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.233928 Apr 05 12:18:48.753947 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 627/1307] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:48 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:49.771432 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:49.772106 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:49.780256 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:49.780762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:49.781597 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:49.782087 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:49.991876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:50.001111 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-8f6947e0-e5df-484d-acb9-bd2772430b05 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.233820 Apr 05 12:18:50.001728 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 681/1308] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:49 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:51.019649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:51.020364 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:51.028646 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:51.029094 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:51.029928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:51.030443 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:51.244741 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:51.253823 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a3eed432-132b-4254-b36c-78f058f5535b tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.238197 Apr 05 12:18:51.254511 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 628/1309] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:51 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:52.076870 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-9d0eac05-54ba-419c-b6c6-4296edf54013 req-1cf2ea66-631b-4830-99e8-7ae11c4e387f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "name": "network-vif-plugged", "status": "completed", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:18:52.079031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:18:52.079031 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:18:52.088460 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9d0eac05-54ba-419c-b6c6-4296edf54013 req-1cf2ea66-631b-4830-99e8-7ae11c4e387f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:52.088964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-9d0eac05-54ba-419c-b6c6-4296edf54013 req-1cf2ea66-631b-4830-99e8-7ae11c4e387f service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:52.107519 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-9d0eac05-54ba-419c-b6c6-4296edf54013 req-1cf2ea66-631b-4830-99e8-7ae11c4e387f service nova] Creating event network-vif-plugged:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:18:52.117436 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-9d0eac05-54ba-419c-b6c6-4296edf54013 req-1cf2ea66-631b-4830-99e8-7ae11c4e387f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044411 Apr 05 12:18:52.118117 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 682/1310] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:18:52.271992 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:52.272934 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:52.281717 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:52.282493 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:52.283348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:52.283843 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:52.508737 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:52.519695 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d75fa3cd-af70-4c8f-af7f-a7d0e9429d23 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.251585 Apr 05 12:18:52.520403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 629/1311] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:52 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:53.539567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:53.540488 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:53.548937 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:53.549564 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:53.550439 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:53.551196 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:53.780063 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:53.790487 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e636e086-4568-4131-a2a9-6b8807390906 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1574 microversion: 2.1 time: 0.255216 Apr 05 12:18:53.801098 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 683/1312] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:53 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:18:54.808920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:18:54.809622 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:18:54.817946 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:54.818531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:54.819402 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:18:54.819901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:18:55.036080 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:18:55.045559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d0683f9e-a915-4ec9-82a8-c982874acabf tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1561 microversion: 2.1 time: 0.240650 Apr 05 12:18:55.046227 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 630/1313] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:18:54 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:27.674411 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:27.674949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:27.683215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:27.683722 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:27.684561 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:27.685185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:27.752334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:19:27.878786 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-fd5153bd-0831-4cae-92a6-24bc9f7039ae tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 204 len: 0 microversion: 2.1 time: 0.208006 Apr 05 12:19:27.882155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 684/1314] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:19:27 2021] DELETE /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:19:27.890767 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:27.891549 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:27.900421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-a279b744-0c51-415e-975c-2a3bdaebebc7 req-fd78ce75-442c-4c17-a5f6-06ca3d49d312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff66a83-2b9f-4f11-8eb6-31d4166134ca", "tag": "8df2e0cf-aba6-4f50-8e67-e3b51b39cb13"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:27.900827 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:27.901341 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:27.902215 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:27.902567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:19:27.902567 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:19:27.902762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:27.912536 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a279b744-0c51-415e-975c-2a3bdaebebc7 req-fd78ce75-442c-4c17-a5f6-06ca3d49d312 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:27.913046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-a279b744-0c51-415e-975c-2a3bdaebebc7 req-fd78ce75-442c-4c17-a5f6-06ca3d49d312 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:27.932213 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-a279b744-0c51-415e-975c-2a3bdaebebc7 req-fd78ce75-442c-4c17-a5f6-06ca3d49d312 service nova] Creating event network-changed:8df2e0cf-aba6-4f50-8e67-e3b51b39cb13 for instance bff66a83-2b9f-4f11-8eb6-31d4166134ca on hv-cinder-78476 Apr 05 12:19:27.937557 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-a279b744-0c51-415e-975c-2a3bdaebebc7 req-fd78ce75-442c-4c17-a5f6-06ca3d49d312 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.264513 Apr 05 12:19:27.938397 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 631/1315] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:19:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:19:28.269112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:28.282639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-50a12e95-25bb-4d72-a9e6-1db3c893741c tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1573 microversion: 2.1 time: 0.397275 Apr 05 12:19:28.284190 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 685/1316] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:27 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1573 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:29.312085 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:29.312865 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:29.321048 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:29.321559 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:29.322484 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:29.322958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:29.565860 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:29.575317 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-927c255e-2718-4736-a061-471c6d50b40f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.276792 Apr 05 12:19:29.575957 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 632/1317] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:29 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:30.593701 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:30.594440 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:30.602197 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:30.603446 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:30.604222 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:30.604712 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:30.814455 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:30.823300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-5002bc36-c860-43df-bedd-bfb59b44ea21 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.233705 Apr 05 12:19:30.823920 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 686/1318] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:30 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:31.840563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:31.841242 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:31.849104 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:31.849611 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:31.850470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:31.850962 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:32.062336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:32.071612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-af8d8cc9-9aba-4a03-a87a-f98f3dcbccdb tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.234617 Apr 05 12:19:32.072255 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 633/1319] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:31 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:33.089554 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:33.090257 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:33.098082 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:33.098639 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:33.099473 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:33.099965 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:33.319711 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:33.328862 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-3eb5169e-5d5a-40ce-bdc2-f9c4b91a4422 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.243480 Apr 05 12:19:33.329470 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 687/1320] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:33 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:34.347172 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:34.347963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:34.355978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:34.356478 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:34.357477 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:34.358066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:34.578828 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:34.588569 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-864196a4-d99e-4133-9e20-c5772dcd6941 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.245402 Apr 05 12:19:34.589212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 634/1321] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:34 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:35.607316 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:35.608338 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:35.616644 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:35.617453 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:35.619816 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:35.620416 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:36.034102 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:36.046160 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-a763db4c-561b-4331-98e8-ce1e6d7548f9 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1454 microversion: 2.1 time: 0.443345 Apr 05 12:19:36.046874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 688/1322] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:35 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1454 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:36.220334 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-c9773065-d6e6-44a6-ad09-848d30648709 req-73919155-2536-4fef-b0bf-4bf90a779da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff66a83-2b9f-4f11-8eb6-31d4166134ca", "name": "network-vif-deleted", "tag": "8df2e0cf-aba6-4f50-8e67-e3b51b39cb13"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:36.222074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:19:36.222074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:19:36.231821 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c9773065-d6e6-44a6-ad09-848d30648709 req-73919155-2536-4fef-b0bf-4bf90a779da4 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:36.232300 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-c9773065-d6e6-44a6-ad09-848d30648709 req-73919155-2536-4fef-b0bf-4bf90a779da4 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:36.250244 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-c9773065-d6e6-44a6-ad09-848d30648709 req-73919155-2536-4fef-b0bf-4bf90a779da4 service nova] Creating event network-vif-deleted:8df2e0cf-aba6-4f50-8e67-e3b51b39cb13 for instance bff66a83-2b9f-4f11-8eb6-31d4166134ca on hv-cinder-78476 Apr 05 12:19:36.255889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-c9773065-d6e6-44a6-ad09-848d30648709 req-73919155-2536-4fef-b0bf-4bf90a779da4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131907 Apr 05 12:19:36.256928 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 635/1323] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:37.065510 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:37.066281 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:37.075006 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:37.075514 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:37.076352 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:37.076840 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:37.151456 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:37.152141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:37.152420 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lazy-loading 'fault' on Instance uuid bff66a83-2b9f-4f11-8eb6-31d4166134ca {{(pid=98312) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:19:37.237558 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:37.246235 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-13281764-b0cc-4cb3-b360-4621fc9b5caa tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 200 len: 1181 microversion: 2.1 time: 0.185594 Apr 05 12:19:37.246866 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 689/1324] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:37 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 1181 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:38.265762 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:38.266585 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: bff66a83-2b9f-4f11-8eb6-31d4166134ca] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:38.275267 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:38.275777 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:38.276617 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:38.277112 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:38.329516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] HTTP exception thrown: Instance bff66a83-2b9f-4f11-8eb6-31d4166134ca could not be found. Apr 05 12:19:38.330166 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Returning 404 to user: Instance bff66a83-2b9f-4f11-8eb6-31d4166134ca could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:19:38.331046 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-bbfe9f79-2474-4035-9a41-3dcad9ad9405 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca" status: 404 len: 111 microversion: 2.1 time: 0.069862 Apr 05 12:19:38.331649 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 636/1325] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:38 2021] GET /compute/v2.1/servers/bff66a83-2b9f-4f11-8eb6-31d4166134ca => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:19:42.692114 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-5117e431-f240-497d-a5dd-0591ebfe9e2b req-e25eea8c-d593-45f8-ac04-4ab5524d84a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc997f-f2bd-49e8-8b8e-3b4309eb377f", "tag": "ef738c12-6b44-4d39-8163-db9d3a41f6f9"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:42.694188 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:42.696231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:19:42.696231 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:19:42.697268 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:42.714884 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:42.716963 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:42.719203 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5117e431-f240-497d-a5dd-0591ebfe9e2b req-e25eea8c-d593-45f8-ac04-4ab5524d84a7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:42.720303 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:42.720993 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:42.723986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-5117e431-f240-497d-a5dd-0591ebfe9e2b req-e25eea8c-d593-45f8-ac04-4ab5524d84a7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:42.756336 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-5117e431-f240-497d-a5dd-0591ebfe9e2b req-e25eea8c-d593-45f8-ac04-4ab5524d84a7 service nova] Creating event network-changed:ef738c12-6b44-4d39-8163-db9d3a41f6f9 for instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f on hv-cinder-78476 Apr 05 12:19:42.763403 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-5117e431-f240-497d-a5dd-0591ebfe9e2b req-e25eea8c-d593-45f8-ac04-4ab5524d84a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074574 Apr 05 12:19:42.764415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 637/1326] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:42.825904 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:19:42.959941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-6f3006f5-5a19-4707-9d44-aff35bf3cd20 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 204 len: 0 microversion: 2.1 time: 0.275544 Apr 05 12:19:42.960775 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 690/1327] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:19:42 2021] DELETE /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:19:42.970044 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:42.970857 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:42.978918 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:42.979656 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:42.980693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:42.981194 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:43.499949 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:43.508925 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-54a36246-7e8c-44d6-8453-f4bc823c9701 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1575 microversion: 2.1 time: 0.543344 Apr 05 12:19:43.509563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 638/1328] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:42 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1575 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:44.529230 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:44.530155 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:44.537989 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:44.538531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:44.539365 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:44.540441 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:44.668173 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:44.678023 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c4b65801-bfa9-4512-9df5-db24bab81142 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1389 microversion: 2.1 time: 0.154149 Apr 05 12:19:44.679008 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 691/1329] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:44 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:44.769931 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-d9a1a078-7dfa-4923-844b-460cc78c6f8c req-6e4670d3-4e9b-4a1f-bac1-5aa09fc763e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc997f-f2bd-49e8-8b8e-3b4309eb377f", "name": "network-vif-deleted", "tag": "ef738c12-6b44-4d39-8163-db9d3a41f6f9"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:19:44.771805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:19:44.771805 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:19:44.782516 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d9a1a078-7dfa-4923-844b-460cc78c6f8c req-6e4670d3-4e9b-4a1f-bac1-5aa09fc763e2 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:44.783014 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d9a1a078-7dfa-4923-844b-460cc78c6f8c req-6e4670d3-4e9b-4a1f-bac1-5aa09fc763e2 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:44.801735 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-d9a1a078-7dfa-4923-844b-460cc78c6f8c req-6e4670d3-4e9b-4a1f-bac1-5aa09fc763e2 service nova] Creating event network-vif-deleted:ef738c12-6b44-4d39-8163-db9d3a41f6f9 for instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f on hv-cinder-78476 Apr 05 12:19:44.807020 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-d9a1a078-7dfa-4923-844b-460cc78c6f8c req-6e4670d3-4e9b-4a1f-bac1-5aa09fc763e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041318 Apr 05 12:19:44.807602 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 639/1330] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:19:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:19:45.695612 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:45.697148 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:45.704998 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:45.705513 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:45.706379 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:45.706876 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:45.845903 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:45.855123 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-79028044-c46c-4ac8-932b-68ae93b0bf7f tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1223 microversion: 2.1 time: 0.163612 Apr 05 12:19:45.855734 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 692/1331] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:45 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:46.873901 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:46.874702 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:46.882707 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:46.883251 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:46.884149 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:46.884637 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:47.006185 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:47.015126 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-ed88fcee-82c0-465d-87c0-9a317b7ec5d1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1223 microversion: 2.1 time: 0.145838 Apr 05 12:19:47.015747 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 640/1332] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:46 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1223 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:48.033941 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:48.034654 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:48.042634 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:48.043138 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:48.043964 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:48.044449 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:48.169871 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:48.178874 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4b030723-334f-42a7-92e5-2bf25ba523dd tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1223 microversion: 2.1 time: 0.149029 Apr 05 12:19:48.179492 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 693/1333] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:48 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:49.013447 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:19:49.013683 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:19:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:19:49.197378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:49.198050 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:49.205836 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:49.206375 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:49.207204 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:49.207693 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:49.279103 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:49.279537 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:49.280038 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.objects.instance [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lazy-loading 'fault' on Instance uuid ecdc997f-f2bd-49e8-8b8e-3b4309eb377f {{(pid=98311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 05 12:19:49.342607 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75522f4b270e42e4b1ce7a6a09beb7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629fa1a565724595a30468e1271ead78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:19:49.351415 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-417b18cb-80aa-403b-a71c-0f80475dcea1 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 200 len: 1228 microversion: 2.1 time: 0.158325 Apr 05 12:19:49.352575 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 641/1334] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:49 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 1228 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:19:50.370986 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:50.371648 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: ecdc997f-f2bd-49e8-8b8e-3b4309eb377f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:50.379544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:50.380056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:50.380889 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:50.381378 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:50.435018 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] HTTP exception thrown: Instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f could not be found. Apr 05 12:19:50.435610 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Returning 404 to user: Instance ecdc997f-f2bd-49e8-8b8e-3b4309eb377f could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:19:50.436509 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-391ecc26-630d-4928-8b21-e9b787a469d8 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f" status: 404 len: 111 microversion: 2.1 time: 0.070474 Apr 05 12:19:50.437122 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 694/1335] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:50 2021] GET /compute/v2.1/servers/ecdc997f-f2bd-49e8-8b8e-3b4309eb377f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:19:51.352914 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:51.353463 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:51.361170 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:51.361690 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:51.362544 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:51.363037 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:51.417684 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] HTTP exception thrown: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. Apr 05 12:19:51.418390 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Returning 404 to user: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:19:51.419279 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-b10219a7-3cee-4c2f-91d4-2455d8b3ce26 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "DELETE /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 404 len: 111 microversion: 2.1 time: 0.071011 Apr 05 12:19:51.419877 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 642/1336] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:19:51 2021] DELETE /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:19:51.428568 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:51.429243 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] [instance: 62f627d1-6185-40fa-8a66-bf568242e6c1] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:19:51.437288 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:51.437788 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:51.438651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:19:51.439133 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:19:51.490348 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] HTTP exception thrown: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. Apr 05 12:19:51.491001 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Returning 404 to user: Instance 62f627d1-6185-40fa-8a66-bf568242e6c1 could not be found. {{(pid=98312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:19:51.491885 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-eb909a58-9fd9-46fb-bb35-8729d6a6e167 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1" status: 404 len: 111 microversion: 2.1 time: 0.067401 Apr 05 12:19:51.492837 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 695/1337] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:19:51 2021] GET /compute/v2.1/servers/62f627d1-6185-40fa-8a66-bf568242e6c1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:19:55.134326 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cdf2fa05-1755-4898-94dc-d0cf9f1ff328 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] Calling method '.version_select at 0x7f010059c510>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:19:55.166705 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cdf2fa05-1755-4898-94dc-d0cf9f1ff328 tempest-TestVolumeBootPattern-1516593558 tempest-TestVolumeBootPattern-1516593558-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-9640565" status: 202 len: 0 microversion: 2.1 time: 0.037297 Apr 05 12:19:55.167978 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 643/1338] 10.222.0.36 () {58 vars in 1244 bytes} [Mon Apr 5 12:19:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-9640565 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:20:57.376725 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: ERROR oslo.messaging._drivers.impl_rabbit [-] [68081e5f-1c81-4ccb-b7e0-6f543fca94a9] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 05 12:20:57.380083 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: ERROR oslo.messaging._drivers.impl_rabbit [-] [01616041-9e6b-4d92-9306-3e8f6c378f36] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 05 12:20:57.381119 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:20:57.381768 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:20:57.384802 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-0a67b28c-be35-4703-b4d5-35fffd258385 req-ea41b75b-571b-4c37-b163-b4bdde71ec2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:20:57.386588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:20:57.386588 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:20:57.390419 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:57.391026 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:57.391961 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:57.392531 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:57.395814 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a67b28c-be35-4703-b4d5-35fffd258385 req-ea41b75b-571b-4c37-b163-b4bdde71ec2b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:57.396314 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-0a67b28c-be35-4703-b4d5-35fffd258385 req-ea41b75b-571b-4c37-b163-b4bdde71ec2b service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:57.413824 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-0a67b28c-be35-4703-b4d5-35fffd258385 req-ea41b75b-571b-4c37-b163-b4bdde71ec2b service nova] Creating event network-changed:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:20:57.419292 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-0a67b28c-be35-4703-b4d5-35fffd258385 req-ea41b75b-571b-4c37-b163-b4bdde71ec2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040360 Apr 05 12:20:57.419958 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 644/1339] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 05 12:20:57.464663 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Going to try to terminate instance {{(pid=98312) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 05 12:20:57.589293 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-d8ecd685-abee-41c0-9751-19bc89241b04 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "DELETE /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 204 len: 0 microversion: 2.1 time: 0.213809 Apr 05 12:20:57.590217 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 696/1340] 10.222.0.36 () {58 vars in 1229 bytes} [Mon Apr 5 12:20:57 2021] DELETE /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 05 12:20:57.600003 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:20:57.601302 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:20:57.610005 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:57.610713 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:57.611552 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:57.612041 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:57.830596 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:20:57.840192 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-c48fac79-5803-426a-85e8-db21f82634e4 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1567 microversion: 2.1 time: 0.244728 Apr 05 12:20:57.840921 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 645/1341] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:20:57 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 05 12:20:58.862499 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:20:58.863599 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98312) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:20:58.884107 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] [68081e5f-1c81-4ccb-b7e0-6f543fca94a9] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35426. Apr 05 12:20:58.890309 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:58.890810 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:58.891681 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:20:58.892141 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:20:59.131143 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98312) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:20:59.141056 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-cc5b5d0a-a45b-42a3-be66-380db01dc9b3 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1448 microversion: 2.1 time: 0.284136 Apr 05 12:20:59.141845 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 697/1342] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:20:58 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1448 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:21:00.160025 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:21:00.160780 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:21:00.180159 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:21:00.181035 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:21:00.182421 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:21:00.183118 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:21:00.238381 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] [01616041-9e6b-4d92-9306-3e8f6c378f36] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35430. Apr 05 12:21:00.310942 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.policy [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2614465974a47cf867b038558815d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ab3fb82a794070a1c024d576d5e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98311) authorize /opt/stack/nova/nova/policy.py:202}} Apr 05 12:21:00.320333 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-4fd12d08-cc7c-4992-8790-04bcffb0cd72 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 200 len: 1381 microversion: 2.1 time: 0.164351 Apr 05 12:21:00.321563 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 646/1343] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:21:00 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 1381 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 05 12:21:00.372260 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [req-d2eacb9e-bfb9-4f52-a849-3b9ee10b7cd2 req-ed23226f-894f-41a8-85fa-74783bd4a6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79c60877-1e5d-4312-a660-a4763656292f", "name": "network-vif-deleted", "tag": "9df1b527-0c54-402e-929e-eecf3d4ce796"}]} {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 05 12:21:00.373973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 05 12:21:00.373973 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: warnings.warn(msg) Apr 05 12:21:00.383095 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d2eacb9e-bfb9-4f52-a849-3b9ee10b7cd2 req-ed23226f-894f-41a8-85fa-74783bd4a6c7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:21:00.384216 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [req-d2eacb9e-bfb9-4f52-a849-3b9ee10b7cd2 req-ed23226f-894f-41a8-85fa-74783bd4a6c7 service nova] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98312) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:21:00.401991 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.compute.server_external_events [req-d2eacb9e-bfb9-4f52-a849-3b9ee10b7cd2 req-ed23226f-894f-41a8-85fa-74783bd4a6c7 service nova] Creating event network-vif-deleted:9df1b527-0c54-402e-929e-eecf3d4ce796 for instance 79c60877-1e5d-4312-a660-a4763656292f on hv-cinder-78476 Apr 05 12:21:00.407410 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [req-d2eacb9e-bfb9-4f52-a849-3b9ee10b7cd2 req-ed23226f-894f-41a8-85fa-74783bd4a6c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039775 Apr 05 12:21:00.408066 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 698/1344] 10.222.0.36 () {64 vars in 1308 bytes} [Mon Apr 5 12:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 05 12:21:01.339195 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '>' {{(pid=98311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:21:01.339897 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.compute.api [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] [instance: 79c60877-1e5d-4312-a660-a4763656292f] Fetching instance by UUID {{(pid=98311) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 05 12:21:01.347682 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:21:01.348214 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:21:01.349040 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 05 12:21:01.349526 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG oslo_concurrency.lockutils [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Lock "1366092d-f79f-474c-849a-63f2d02cf0e6" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98311) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 05 12:21:01.540074 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.wsgi [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] HTTP exception thrown: Instance 79c60877-1e5d-4312-a660-a4763656292f could not be found. Apr 05 12:21:01.540750 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Returning 404 to user: Instance 79c60877-1e5d-4312-a660-a4763656292f could not be found. {{(pid=98311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 05 12:21:01.541651 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-f9c5c187-464f-428e-bc08-2750143fa7c5 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f" status: 404 len: 111 microversion: 2.1 time: 0.207230 Apr 05 12:21:01.542299 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98311|app: 0|req: 647/1345] 10.222.0.36 () {58 vars in 1226 bytes} [Mon Apr 5 12:21:01 2021] GET /compute/v2.1/servers/79c60877-1e5d-4312-a660-a4763656292f => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 05 12:21:01.746642 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: DEBUG nova.api.openstack.wsgi [None req-e37498d7-d4ee-4fb9-adf9-3ffe0f3882f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] Calling method '.version_select at 0x7f0101a43e18>' {{(pid=98312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 05 12:21:01.764401 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO nova.api.openstack.requestlog [None req-e37498d7-d4ee-4fb9-adf9-3ffe0f3882f6 tempest-TestShelveInstance-845314148 tempest-TestShelveInstance-845314148-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-985921536" status: 202 len: 0 microversion: 2.1 time: 0.023091 Apr 05 12:21:01.765029 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: [pid: 98312|app: 0|req: 699/1346] 10.222.0.36 () {58 vars in 1241 bytes} [Mon Apr 5 12:21:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-985921536 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 05 12:21:14.062636 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:21:14.063212 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:21:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:21:16.590625 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:21:16.591154 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:21:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:23:09.031086 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:23:09.031657 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:23:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:24:34.091829 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:24:34.092451 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:24:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:24:36.610579 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:24:36.611062 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:24:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 05 12:26:11.177624 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 05 12:26:11.178187 dv-cinder-784763-1-iscsi devstack@n-api.service[98310]: Mon Apr 5 12:26:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!